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PREFACE 



Fdt perhaps a hundred years now, the status of nursing has ^, ^ 
advanced in fits 'and starts frbffi a helping hand t5 a- profession, such » 
advancement having :been meteoric" within the past two decades . The educa- . 
tidn-^f^Trar^rperrotme-F 

settings and institutions, each adapting in its own way to the heightened 
demands of prof essiqnaiism Well jto the increasingly complex health : 
care needs of our society. Thus, nursing education is, in our time, : 
experiencing exciting changes in policies, in structures and in concepts. , ; 
■. One such change has been the development of educational structures 

to facilitate professional mobility among non-baccalaureate registered . 
nurses. These educational ventures . comprise the newest and fastest-growing • - 

model of nursing education; as such, they now command the attention of pro- ' 
fes.sioilal policy makers, educational administrators and, most recently, ^ 
program evaluators . • ; . ; 

Although the overall problems, principles and rationales of . 
educational evaluation are Widely applicable to a variety of disciplines, . 
^ specific tools and methods are frequently developed as particularly appro- 
priate to certain acadi^Lc fields, " Similarly, although nursing education ' 
as a whole shares many coinmonalities, in terms of content and . standards of 
.■ excellence, the evaluation of an RN/baccalaureate program poses challenges = 
peculiar to this timely and innovative model. This volume documents in 
easy-to-follow .deta-il one comprehensive and successful research design 
drawn up and implemented to meet that challenge. 

• The National Second Step Project is a federally funded Special 
• Proj ects -Grant launched in 1978 by a small research group affiliated with . . ■ 
' the Nursing Department on ' the Sonoma State University campus in northern 
California. It was Sonoma's nursing curriculum, a post-licensure upper 
division baccalaureate: degree program for RNs, which gave rise to the term 
. "second step" as a category of r^grams designed expressly to serve the 

o v-^'-' : A ±±i — — . ^ 
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ed^ucaHonal^OT^^ the student whb hid klready, by 

yirtqe of "licensure; taken the "first step." ■ : 

From the starts strong and heated arguments challenged the 
acceptance of th'is curricular modei. An organized method of 
evaluation was. esseStiali and- the Sbrioma program provided ai( optimal 
research-site. Ovkr the years "from 1972 through 1978, a tru\y gkrgantuan 
amount longitudinal "data was systematically gathered, analjzed, inter- 
preted iSd incorporated into a series of publications. (Searigh^, ed., 

1976; Wilson e't al., 1977; Wilson and Levy , . 1978; Dean and Jako^i978; 

^ako^etvrafaif4irl9;;^85^;T^n^ 



• The present authors had all worked together on^the final study ' 
in that series--an inquiry which explored an J evaluated that one particu- 
:clar: program in^g producing a hefty volUffie of f indings .remark- 

abie for their richness arid scope but severely limited "iri generalizability 
to other similar programs that were springing up around the country. ' The . 
next logical itepV the^^ was to expand, the target of "oSi coricern Xo include ; 
other A^ariations bri the theme; thus, to deal not with a sirigle program in 
isolation, but with several programs sharirig the distinctive "second "step" 
approach, to. nursing education. Hence our name: The National Second Step 
Project;. ■ '. . " . 

The project as a Whole has several objectives i only one of which 
is, as stated in-- our grant proposal, "to cbriduct a. multi-cainpus comparative- 
evaluation of second step prbgrams on a natioS-wide basis." That one, 
however, is the central pivot--the focus of most bf our creative work, and 
the i^etus for the publication bf this mariual. - 

What we present, then, is a case study of our^ research process. 
The reader we address mbsr. directly is already aware of the NSSP and is 
sleeking further information as to its protbcbl and methods. But the circle 
widens to include others whbse interest is less specif ic--nur^ing educators, 
corisiimers of evaluation , research, and those in-vbl-ved in developing a new 
educatiorial prbgram^ whether as evaluatbrsi. teachers or administratbrs. 
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iNTRODUBTlDN 



k. Pl l rpd se 

.: Over the years r the research sftptibri of the Nursing Bepartiiie^ 
at Sonoma State University has received numeroas inquiries which, taken 
tbgetheri strongly influenced oar decision to produce this manual. Some 
were naive requests for "all your findings**; others included a plea for 
"heip with bur bwii self -study." The present volume contains only the 
iiaresr^etSTO^ffi^Si^TOa 
provide a great deal bf help. . 

Originally, we had thought to distill from our collective exper- 
ience a general guide tb research in nursing education--a "cookbbbk," if- 
you will. The potential - readerihip for such a guide is "clearly present 
and rapidly increasing. But how to respond to their needs was quite , . 
another questibn. 

There is ho shortage bf prinFea 've^ffi Ivalu- 
ation r esearch. Literally icores of such books cOVer the topic in inf 1-;. 
nite detail. The trbuble is that they ari usually written I o^iilarchers . 
Following the cookbook anal6iy. they are guides to gburmet cuisine, and 
likely to be written in Frerichl The audience we address niay include a few: 
who want tb-kiibW hbw-tb inelt batter without burning it. 

Jinother difficulty with a general handbook is that, fb* 'obvious 
reasons, it rarelys treats the very specific situation or problem that, 
arises in the use of a- particular- reseaircTi design. For tlie assistant pro- 
f^>,«nr .^n, tb her amazement . ts .p laced in charge bf evaluating a new ly : 
designed curriculum^ basic principles albne nayjje of limited utility . 

Our purpose, there£o^:S, has been to chart a well-defined course 
along a very specific route. We present, in essence, a blueprint for the 
research currently being conducted by the Natibhal Second Step Prpj ect (NSSP) 
Here y6u wili find not-orily-ideas- ab£Ut--evaluatio 

-^Sgli^tibn of t'le design^we^ implemented; nbt mere advice on questior^ 

Ttaixe-const-ructionv but- des^^^^^ 



not vague suggestions as to how you might process data, but an explanation 



, _ ^ , ; , ' ■ , , , "t . . _ _ 

of actual procedures we fblibw; riot an array: of . analytic scheiiieis differ- 
entiaiiy appropriate to various research pfbblemSi but ari, outline of a 
sound, woikabli aSalysis of these data. ; This is not. to imply that it's 
all nuts and bolts: we also state our assumptions, the theoreticai basis 
for bur methodological approach, and the ratibriales that support action; 
But our basic intent is tb shbw rather than to tell. 



• \ 

/ B. B ackground 
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The cbriceptual forerunner of the NSSP was„a dembnstratibri study^ 

decisionr"regarding desigri arid . methodology were made with reference to 
that experience-, the next few. pages contain a very brief bVerview of^the 
setting in which it was carried but, the questions posed, concepts gen- 
erated arid its ackriowledged limitations. , _ ^ 

Initially uriique tb Sorioma's two-year baccalaureate program was 
the requiremerit that entering students must have earried ari Associate of 
Arts degree or its equivalerit arid must also hold a current ealifornia 
license as ari RN. Assuming that the prior learning represerited by those 
two ad mTssTbn criteria- forms th^-bundaJJ.Qri.._upon which £r6f^ssional educa^ 
tion can be built ^ the faculty designed a process-oriented curriculum ^ 
which emphasizes commuriity health and stresses a brbad knbwledge of the 
health-illness coritinuum,, prbblem' solving, decision- making, and prbgress 
tbward self-actualization. - 

in additibri to- regular course work, the first year iricludes 
clinical learning experiences iri a variety of conmiunity settings, encourag- 
ing a brbader understaridirig of the many Variables which influence health 
arid illriess. Self-awareness, group dynamics, and iriter-persorial relation- 
ships in groups and in health^^^a^ stressed. 

The senior preceptorship year of f ers two optioi^^s. One is^ a 
ctirriciilar contract in which the student seiects^^^EXeW-^^ 
to explore in depth", obtains an off-campus preceptor, arranges for necesx. 
^axy f atSlitieSi devei^^ action, A^orksjout^^^^a^^^ agree- 

ment with the agency, and provides a plan for. evaluation of his or her 
-^vr^rp'?'? ^^'h^ s truetu red^f 5mi l^nurse practi- 
tioner preceptorship, conducted in connnunity clinics arid pfiysrcians*"==^" 



offices. Qualified FNPs serve as preceptors . arid ^ - .\ 

Conducting, ari evaluation of this Mthei: cbmplex curriculum was 

rib small. .task.., -Heterogeneity bf.-enteririg studerit populations mitigated : 

against ii'n^listic pre^post meaWtes of impact; and" the fact that the .. 

prograni 'itself w^s still devilo^ing argued against a static or cross- 

sectional apprqach. . * .. N 

From the analysis of longitudinal student data, six centr.aj 

concepts emerged: .. V " 

" an bvlTinrvi-e^of-pr^-entry_cgar^^ tics shared by most Sonoma 
students. Iri the eyes of the faculty, or^the -prof essiOri.^rg.o^^^ 
general public, most' eriteringrfStudents already looked and acted 
like nurses. ' 

2) - Status Maintaining . Retaining a previously earned status—that, of-^ ^ 

TTIcogriized member of the nuTsirig prof ession--su^^ as a major 
source of motivation for these registered nurses at the entry phase 
of their baccalaureate study; 

3) Ind ependence Seeking . Both persbriality conf igurations^nd a ho§t bf 
ittitudinal" items point to an additibrial set of ingredients in the 
make-up Of this student group: a need" for independence, a resistance 
to" authbritarian thinking, a desire for personal autonomy. . 

4) ^ala n&ing^ ;z_^pically, students were-mainta±iiing_a_deUcate balance 
among threTsets^F-Rfle- id4ntitles_indjdeinands :- a) asTstudBnts-xn 



among tnree aci.o uj- '■^■^'^ - _ 

a non-traditional baccalaureate riUrsing programi-b-)-^s_jreglsterea ^ 
.nurses, most of whom Continued tb be employed, ; and c) as mature 
"re-entry women*' 'with community and/br family responsibilities, 
engaged in the process of restructuring their lives.. 

5) Fr ontiering ; In an attempt to discoverthe kirids Of roles towi^d 
.Which students were predisposed, four nursing orientations were 

identifiedi^^-raditional, academic, leadership and frontiering. 
AifehmrgT^he first three might be expected to typify BSN students 
generally, the preval^Hce of the froritlering orientation illuminates 
■ ?he distinctive Wture of this student body. It defines a student 
who shows interest in positions that are non-traditional; questions 
: established health-care delivery; is innovative and flexible in 
general. qrienta^tibn tb riUrsing. _ . — 

6) TTiP Jttdeoendent Prof esslonal r -This, :role concept, posited as a syri- 
thlsis bf 3) and 5) above^ is not defined by a.particular nursing 

. -activity, practice setting or clinical specialization: Nor is it- 
necessarily individualistic; close collaboration with others is 
—compatible with the rOle definition, it does, however, prQvide^the 
practicing nurse with oppbrtU 

in the iolutioS bf problems, arid for determining (within flexible 







; Jjbunaarles) the iUitibility bf various -cdurses of ictibn based on own 
pydfessibnal competence;:. f * 

• - Student data -were aiso used to f ovulate and tp measure three _ 
' separate dimensions of "success": (1) achievement bf the diverse goals ^ " - ' 
bf the program. (2) academic achievement during the period of enrbllmehft, 1 
aSd (35 a personal, subjective sense of 'accompl'ishment. ■ Altl^ugh the 
three measures were sStistically distinct, a f ew coinmpnallti\p were noted: 
certain shared personality characteristica^s^nse of "special expectationi" 
oi the program at entry, ahd positive ^relaSioji^s^^^ With at least "some" - 

attrxbutes. . ^ 

From an examinatibn of teaching s-tyles, setting and curriculum, 
nine central concepts were generated: . • s_ * • 

"l) Commun^lism .' Faculty behavior evidenced a.tendency to want to^ct ^s_' ' 
a group and /ls.individuais. /to be answerab^ and available to the- gro^ip. ^ 

2)" Interactlonism. The goal of ^interactive vS^enness is fbrmalized as an 
; ithlc— it is not seen as merely.^useful or efficacious, biit as good in ^ 



1 



itself. 



3) 



F eminist . Ddctoring may be. seen as a male responBe to illness, whereas 
nursing is seen as a^femaie way to create, and maintain health. 

4) PSiitical Change^ The faculty seeks and encourages^'in ^eir students T 
an active leiisl^tive, organizing and confrontational role; in imple- 

menting change. ■ ■ ' - ■ \. c , / ^7 - 

55 The Ethib of Availabi-lit j and Wargth/Suppbrtivfeftsgs. iri.teractionism ' ^ 
IThereTxtlnded tb Students. More than merely descriptive, it- emerges^ 
as a behavipral avjrm. - . • , 




65 The Student ?.eer. Distinctive characteristics: 6f RN students tend tb 
difine prbgrt^conte^t, and to' encourage egalitarian attitudes and . 
flexible teaching styles. . - . ► * V \. :^ 

7) Ther apeutic , Affiraative and traditional Styles . The therapjatic style.; 

assumes th^ t 'students^ ^ RNs and as women.; must gain knbwl^dge^ coupled. 
■ with assertiveness. The affirmative style tends tc^ treat students as • ^ . .. . 

fellow professionals. The traditional style makes no assumptions aboi^t^ 
' the personal' needs of students. Individual faculty member^, o. ten emhody • 
' more than one style, depending upon smi^ct-Liatter ajid -class -size. , . 

85 Facilitators and instr^^etors ; T^ching styles, were also differentiated 

according to thf teachers' assessment o-f the autonomy bf their/earners . , . . 
"Facilit:ators"/see their students as self-directed^. and a-ct pr^arily - ^ 
as resources, /sounding 'bpards and sources or enc rinstructprs ^ 

' eit^Jloy more traditional, acadetnic technique?. ; , . _ ' , 



9) Additive Model of Carrlculuni . The faculty, has a notion of what RN 

. students lalEiT^nd what they heed in order to become professional nurses 
Thusj the curriculura^ was, in a sehse^ built from the students rather. . 
than- the other way. 

Gbmbining these ideas with other research findings, the bembhstra 
tlori Study (Jakd et al. , 1978) put. forward a conceptual explanation of the 
basic social processes occurring in the early years of the: Sonoma program: 
that of "shaping professionals.*' The analysis cohcerned itself with what- 
happens to students during the course of their experience in the Sonoma 
.prb«r.ani. ......These.pEocesses ...through .which -a. technical identity is supplanted 

with a professional one, are posited as those which may distinguish this 
curriculum model from the traditibrial four-year BSN curriculum. . 

As a program evaluation, the Demonstration Study represented a 
significant accomplishment. As ah e^lanatdry inquiry focused upon a 
curricular Iriribvatibn which now exists in several slightly varying forms, 
.however, it. .is limited by Its total reliance upon data from a single pro- 
graS. Findings pertain to a singie (though influential) campus arid to a 
single (though extensive) time period. In the NSSP, irisights gleaned 
from that pioneering effbrt are carried forward. 

C. The Sec<>a4 Stefi . Model: cbntext and substarice 

' • While each iridlvidual second step program is . Ibcally iriitiated,. 
bur previous research suggests that larger Sbcial factors have influenced 
the development bf this mbdel bf baccalauriate nursing education^, prbmbting 
its cbllective growth and conditioning its curricular characteristics. 
The same social forces that, In 'a sense, created the programs still cbri- 
tlriue tb. defirie them. They live within the studerits, the ' faculties and 
the educatibnal settings. We cariribt Uriderstand one without the other. 

The national crisis in health care delivery, in terms of cost 
iSd quality 6f/4ervices, is well known through a. variety of books . articles 
arid in the press. Health prof esslbhals, once the prbtbtypical bastion of 
stability arid trust, now find themselves under fire from a dissatisfied 
and sometimes outraged pul.lic. These facts arid sentiments give the pormal' 
penchant for professional improyemerit a riew urge-ncy, and provide some of ; 
the. energy behirid effbrts at change. The new' awareness bf the public that 
its health care is not what it. might be,^br even should be, is only part 



S ■ -a ie-examlnihg of institutions that has swept this cbr't ry in 

■ J^ITr the last decade. \ 

Most impbrtaritiy for the Xpurposes of oar research^ it is hot only 
J that is being challenged^, but the status and role of women, 

.5 and practicality^ of higher p:ducati6n. Nursing edu<ia= 

'j : tidh is one point of intersection fo^ all these controversies. Baccalaur-; 
XoT^reate pr6f>raiTis ge^^eist ered nurses addr^ess the following larger themes, 
! ' ■ briefly put into context below: ;ndh-trad^itiohal students, the 'public dis- 
„ l^ealth care delivery, thy women's So vement^ and hew 

directions iri health, care. \ - 

i — The of t-niehtibhed post-war baby bdpm beginning in the late Forties 

produced a' flood :of college students for tb^ Sixties, and an unprecedented 
' * boon in faicilities and persdrihel connected with higherx^education. The 
> number of traditional college-age students dropped off dramatically in the 

■ Seventies, and educational institutidns have been forced tp seek quj: students 
: ""^^ age» background and pursuits;- The usual \reluctance of 

■ cdi cater' t^ w6^king. older adults has\inelted away with declining 
- enrollments. Academe credit- for these olde^ sVudents' experience and 

y the college opened to them. , 

' . It is no' accident that nursing has been one of the chief f ields . 

■■ . td which students, particularly nort-traditional ones, are fiocking. The ^ 

- piiblic perceives Wsic as frequently aloofy iinpersdnalV and expensive. 

: Becoming more and mo?e popular is' thp cbricept of the middig level, practi- ; 
^~ T T B the^ f^inctions of , the old family doctor, a , r 

■ person who'' caj^ftein regularly to promote t.he patient 's health in a ' • 
\ pe^^^ not ffeen only in A crisis,' under conditions of ; 

^ ; • medicinal .uirgency, and foE an exorbitant fee.' Og^,:ahswer to that is ; 

incfeisihg. th^ ranks (If pr'dfessionally prepared riursas. ' DepaTtments for 
• 'pr^ of hiilth -professionals have .beeft growing, ;±^^ 

" ;- • ■ . . _ ■ _ 1 . ■ ^ X . . . - 7 ^ , ... 

: ' ■ that ma^^^ the past. . ' c . ^s. 



. • - " it is not only' the required, level of -prepara^^ that 'lias ris erf' ^ 

V in nursing, but; the^ level of expectatiort of nurses themselvesV This is' ^ ^ 
""■-'^ . 'du^ of the women's Wov^metit. Recent. .■ . f 

■ -• changes in the >-^tatus ariVrole^o^ ; \ 

::-?r y : ^^^ GhailiSges td the domih&nce of 



physicians is the medicine parallei chilienges tb the dcwiiihahce 
of ihalies iii ali facets of American life; 

r- Thvxs we have the institutional conditions met in the bpehirig of 
the college doors,, the professional cbriditibris set for producing more pro- 
fessional nOTses,- and the psychological conditibiis fo^ challenge and self- 
imprbvemeht established by the demands of the women's movement. ; 

-gbtne-^spects-^f-the-nursing-&urricuigin,i:J^^^^^^ the products _ 



of circumstances impinging upon. nursing. Advances in the technology of 
curative medicine, along with prblif eratidn of medical knowledge, have 
contributed to increased spe.cialtzatibn on the part of physicians. This 
specialization has tended to geb the surgeon closer to the technical 
minutiae of physiolbgicll pfbblems, but farthe? aw^y from the patients who 
have them. A developing lay and professional sblution to this difficulty 
has taken the shape bf various doctrines of "holism." ^The new prof essibrial 
thrust in tiur^ing stresses carini over curings preveritibn over treatment, 
a "bio-psycho-social" view of health maintenance over a Sedlcal model of 
disease treatment. ' _ 

• In- addition tb offering a curriculum content reflecting the 
varlbus aspects of holism descHbed above, second step prbgrams are fre- 
quently designed with the non-traditibnal student in mind. The curricula 
often include sbme self-directed, contractual study; cburse cbntent empha- 
sizing self-actuallzatibn and leadership; and evening, summer, and part- - 
time study. The characteristics of "^these older, experienced students 
influence the programs as much as the prbgrams influence them. 

In order to describe the programs we are studying, we need to: 
considerls^hsL^pact of certain seemingly e;xtemal factors In our plan of 
inquiry. We Include within the scope of our'-research a cbncern for the 
social, educational and prof essibrial cbntexts within which such programs 
develop. And, We adbpt a philosophy of inquiry and analysis calculated 
tb generate ideai- and: concepts coricerrilrig the relationship of this curric- 
ilaS model tb its" histbry and to the social 'forces of which it is a part. 



. CHAPTER 11 

* • THE DESIGN: Muiti-campas Evaluation Research 

in higher education^ evaluation research is usually limited to 
a single campus J or even to a single academic program. Although frequently 
longitudinal in nature and/or pertaining to more than one student sample^ 
program evaluators rarely need to be directly Concerned with design problems 
"iiTtHieFi^^^ . coSpaSisons in the early stag"es of their investx- 

gationsi At the same time^ any program is in reality part of a larger _ 
population of "all such programs . " In the final interpretive stage of even 
a single program evaluation^ the researcher needs to be aware of the broad 
outlines of that larger reference group, both for comparative purposes- 
(i.e. , being able to say how the program in question is different from or 
similar , to it) arid iri order to esHmate the generalizability of firidings. 

In general, topics dealt with in this chapter are part and parcel 
of any research design, regardlesi of scope: defining the population and - 
the sample; posing objectives, setting a timetable and adopting a methodo- 
logical approach. Each requires a decision based upon a sourid rationale. 
Iri a serise, such, preliminary determinations are no more important? than the 
smaller decisidris that are We -as you go along; it is just that ydU have . 
to'ihake thetn first—and then live with them. ' - 

A. Bef ining the. PbpuiatiOn ; -the program survey ; . 

; The NSSP research desigri was outlined in the early part of 1977- 
At that time ^ although rtiUch had been wiritteii about the idea of second step 
programs, no published empfrical studies had success-f ully defined and 
eriunierated this, liew phenbmenon^^^ education. ^ . 

From our work bri th-e Demonstration Study, we suspected that ' = 
. secxjrid step programs generally wete . quite differerit from the other, three 

modiis usually referred' to iri the literature— diploma,, asso^ciate degree^ 

and gerieric programs. But we .needed a way to cbrifirm or refute that hunch. 

We also needed a way tb describe the institutional population from which 
\oiir study sample would be Sravm, and to provide ari" empirical background 

against which to view their defiriirig characteristics. / 

• : . ' T^^ augmented the comparative evaluation by 



adding a p^eiliiriary step: the prbgratii survey. , Daiing thlf initial phase, 
the NSSP sought td establish contact with every prbgram of this type 
throughout thi nation, including those rtbt yet accredited. To do that* 
we heeded only two things: a complete miiiHg list and an appropriate 
data-collecting tool. Neither was readily available. 

Since this particular group of programs had never been consti- 
tuted into a "second step populatibh," we Used a "snowballing" tschnique 
( SuafflanrT'97'67TP^2T0^^-t5~^^ 



ing together a list of 108 institutibhs that we thought might have such 
curricula in bperatibri, we wrbte into the survey form itself a request 
that respbndents tell us of others that they Knew abbut, thereby eventually 
i¥creas'ing our~p^^^ 



General speaking, the less you khbw, the' mbre ybu have to ask. 
This posed a problem: we actually knew very little about the programs on 
bur augmented mailing list. At the same time, bince we Were addressing \ 
the survey to busy department Heads , we "realized that a long, complicated 
questionnaire wbuld stand little chance of being returned. Our solution 
to this dilemma was to approach the cbllectibn bf data in tWo ways. First, 
we limited our actual questions to a single page of falrV'' basic descrip- 
' tive information: type of program and ."parent" instituc ■ , how long it 
had been in operation,- accreditation statu^, and a^Variety bf prbgram 
statistics. Second, we. Requested, in additibn tb the brief survey form, 
a current catalbgue arid/br other descriptive publications. Curricular 
details included in these materials enable us to refine the operational 
def inition of the population we wished to describe~"baccalaureate pro- 
grams designed expressly for. registered nurses"--and tb specify criteria 
for inclusion-i-n-or,exclusibn frbiii the survey population. 

Never underestimate the importance bf "piloting" a new instru-^ 
ment. N6 matter how crystals-Clear each item seems to you, your • respbndents 
•wiii prbbabiy find a "wroni" way of interpretirig it. ; We ran the first ' :. 
version of our survey past chairpersons of a few nearby nursing program^, 
clarified the items. with which they had difficulty, arid gbt it ready fbr • 
mailing. 

What MLh "sribwballirig" the sample and devising three fbilbW-up 
maiiirigs, twelve weeks elapsed from our original mailing tb the final • 
ciit-off date for prbcessing returns, '^en-, with the population defined 
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and with estlniates of its size and basic ch?acteristics, we were ready to 
focus in on the study sample. 

B; Defining the SamBle; the six- camp us study ./^ 

"Baccalaureate programs designed for registered Sufses" slibuid» 
we reasoned, include two curricular patterns. One is the classic "second 
step" as represented by the Sonom curriculum; i.e. r programs which deal ^ 
only. with upper-division baccalaureate nursing education, admitting 
students with Junior standing. The olher is the ^two.plus two"-va™tT— 
i.e., nursing- programs which award both the ADN and the BSN. In this 
latter typ^, only the upper-division work constitutes the real . focus of 
5ur evaluation. But, since many students continue from lower i to u^)per . 

'dlvisi^wTtMrai-s^^^^^^^ 
their formal education, these two types of programs are treated separately 
for certain analyses. Both, however, fall within the operational def i- 
nitioS of the population of interest, and will, for most purposes, be 
refetred to in this manual as "second step" programs. 

ThI preceding section conveys .the impression that only after the 
institutional p5pulation was defined would a sample of those programs be. ■ 
.selected for intensive study; Theoretikally, that's the way it should 
work. • But in the real world of grantsmanship , theory sometimes bends to 
. accSmniodate "concrete reality, in order to assure the funding agency that 
programs so selected would indeed participate'in the study, it was neces- 
sary tb chcosietli^ study schools and elicit their written support for the 
project prior to submitting the proposa^^ 

Two major factors argued against a random selectioii from among . 
"all second step programs." First , as of early 1977 ;that population had ' 
Yeiio be defined! thus, a random sample was not feasible. ■ Second and./ 
tnbre: important! selection criteiria should serve to. screen out programs ■ 
^ichi either because of n^esfe or^because- of failure to meet prof essional 
standards,, wbuld^ c a definitive portrait of this cur-, 

ricular model. One singl^ criterion, provides. the simultaneous solution 
tb/both problems: mN acc?^^^ 

•;: ipubiished sburces furais the names and addresses of five ; 
second :stW .prograSffi which ^had: received NLN acc^editatioii: .During; the 



._ ■ ■ _ \ ■ . . . . ■ . . 

time we worked on the prpposai^ we iearried of one tnore, bringing the total 
.khbvm pbpuiatidn to six. ^ It was an awkwarid naraberT-^sbinevjhat large in 
vi^ of the complexity of the research design we had in mind, yet not 
large ►enough to permit representative sampling. We therefore decided to 
include all six. 

Far from constituting a homogeneous sample, these six sites 
cover: an impressive range of institutibrial characteristics. Half ate 
strictly upper division; the other half are two plus two^ Three ard 

~"~d edited ly~u^l3an^^ 

tax-supported public institutions; the other two are in private institutions, 
bbth^ of which are supported by the eathoiic Church. Three bf the parent 
institutions boast a student population b£ over ten thousand; two are of V 

.-.inoderat^si^e_(L,OQOTlO^OOO one is^ftuite, siraU^^ ;?^9;::^^ doctorate- 

granting institution^; two have Master's programs; twb are trie tly for 
undergraduates . The total enrollment of RNs in the nursing\ departments 
varies from less than 50 to approximate^^ two, hundred. Finally, they are 

. spread clear across the country from the Easterr;. seaboard to \the Mexican 
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border. . 

• Without a knowledgeable and involved liaison at each site ^ the i-- 
mere task of coordinating data collection and bther evaluation activities 
would be forrriidable; achieving the kind of insight and understanding we 
were aiming for would be well-nigh impossible. Thus^ ofie af the ^rliest 
steps' in the research-prbcess was to identify one faculty member from each 
participating program -cap^^ of playing this indispensable role arrange- 
for compensation or'' release, tirae^ and endow the role with a suitable title 
-•^that bf Ev^uatidh Associate. 

. e. Posing the Obiectives ;r.: the art bf cbmprdmise 

This section summarizes the thinking of the NSSP staff in posing 
research objectives.; tha would be both productive ^and'^ realistic.:. The 
goals we set reflect a compromise between the authors V bwri philosophies 
of research, pragmatic consJ:rairits sUch as the availability of resources 
and experti^^^^^ and our personal' perspectives on current; ^ issued impinging 
on nursing' education. . 

. Readers-.>whd plan to use this manual as ah actual research guide^ 
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whether to repllcafee the present study or to adapt parts of it t6-tih|^lr 
bini purposes, may not share ovar phiibsbphical berit| similarly, they m|y 
operate oSde? differing budgetary restrictions or wish to address^djff ereht 
audiences. > Regardless of the specific cirbumstahbes, however, setting 
overall objectives is an important step. By setting foith the variety^ 
of considerations that influence our own. aims^ we provide both the rationale 
that underlies the NSSP research and a coribrete illustration of. the process ■ 
by which such goals are formulated. . 

. ^fr- PhiloSOphtcal^foundatlbhS - ^ ; ;z:i;;z::___::;:^,;^^^ ^ 

- * _ _ ■ . _ _ _ _ . . ^ _ J__ <_ 

Chapter i discussed social forces which have given rise to _ 
second step programs (see pages 5-7) . Two characteristics related to those 

origins. have conditioned our approach to this study.. First, the programs _ 

are innovative, the decent products of changed and chahgini sociai 
Second, they are locally initiated and diverse Responses to these realities, 
rather than being administratively defined creations of a state or federal 
agency. These two features, in addition to the paucity of informatibh.aT^QUt 
second step programs i led us to favoi research bbjebtives aimed primarily .; 
at developing a descriptive and interpretive model of the ptograms selebted 
for infcehsive_ study. . • , 

Because we bbhsider; such programs, as a grbup^. to be still-- 
deveibpihg innovations in nursing education ^ we depart, in somfe ways from 
a standard approabh tp program evaluation. Evaluation research usually ^ 
tries to measure 'gbal achievement. Among sebpnd;:step programs, however,- 
definieionsbf success are themselves in transition. To describe the model 
in its newness is'i in a sense, to dfesbribe its criteria for success.. Defi- 
nitions- of success in exTjanded-roie nursing are, . therefore, seen as part 
of the investigation j not as a predetennlned standard of measurement:- • 

: ' ^ ^^'' ^ T^^ those 
characteristic of eWlUatidn. st.udi is th'it we are not ..dealing - with "± 
p.rbgrain'' ait all, but wit^ made up bl separate .programs—all ^ 

locally initiated respbnses tp societal needs" which are national in scope. 
We are dbaling with a phenomenon. Each program sees itself -as in tune with 
national tfendsj and each conforms in its own way to NtN accreditatioh 
iitandards. • What'we:^ thb' effibScy of a social 

inbvement; : r,- 



We began with ideas we had developed about what might be 
called a "second step packigi'^; in Which ail the cdinponents--thi studeiitSi 
the cur^icalaf objectives arid the faculty— are new", and in which each part 
iitfluences the- others. ^ Questioni we pbse should reflect this dynamic 
interaction . But rither than merely confirming or denying that. formulation,: 
the questions should imply in integrated analysis which further explains it. 

edr objectives, thehi are aimed at, constructing ah analytical 
descrlptibn— a model^^bf such programs, as a way of finding out just 
constitutes the programs. VJhat do they intend? What are. their students 
and faculty lik^^^^^ tliiy address- the new trends In professibhal 

nursing? Are they contributing to the development of rieW standards and., 
petsijectivei for hursing practice? . - 

A phildsopl^ of Inquiry is not an afterthought ; It d^.terraines 
the type of questions you think are worth answering and the type of Study " 
you conduct in order to address them. Our research bbjectivtis stress 
explanation over proof , and understanding over prediction, 

^ 2* P-ragmatiC 



7^ 7^-,,^ The overall perspective or philosophy upon which the NSSP 
research design^is-Jjased sits^ ..^^ for the inquiry. But before the ... 

objectives are put into fihal^^^^^ other factors must be taken into 
account, three of which * ate discussed^^^^-i^ ; 

■ ' . One of th^ first- things to think about i^^^^^ 
address. , In addition to our -ftrndlng-agericyr-wfe-have three significant-^ : . 
audiences in mind in drawing up our- res.earch questions: i) the partici- 
'patihg. programs themselves, 2) the nursing prof e'ssion generally, and 
3) researchers in- the health "fields , fanning out -to include educational • 
researchers and other social scientists. ■ ' ' 

■ r. The first audience, we assume, is most interested in knowing . 
•"How are we doing?" They want findings to provide a good, objective: view 
of their operations and of theif students , paiticularly in terras of academic 
and professional achievement; The r.ecoiid grbup; is more iiiteiested in a 
solid, empirical deliheating of this new model 5f, professional nursing 
preparaj^ibh.. What makes it work ind what does it produce? _ Do we really 
need it? The third audience may approath our reports with a more clritica'l 
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eye; . The^ drftiqtie the sburidriess-df the.^i^^^^^ the adequacy of the 

iHklysis and the fruitfulneii (f5r the -prii-pbses b^further resiirchj bf " 
th^" findings; Our statement of research objectives must satisfy all three 
potential sets bf readers. ' I 

"A second-guidihg-principle is to set goals that are reason-^ 
able arid attainable within the constraints imp^osed by your projected time- 
table, data-processing facilities, arid budget. Attending well to these 
constraints carries a large pay-off in terms of how well ybU can ultimately 
accbmplish the research- aims; 

. ' ; Data-processing facilities were a known quantity. We had 
inherited frbm our previbus study d good wbrking relationship with the 
camous computer center, and krieW its capabilities and limitations.. Time 
and money were less well defined; the best source of information is always 
identical with the expected sburce bf funding, in the case bf- the NSSP, ,. 
we based our pl.nriingbn federal guidelines issued by the Department of 
Heaith, Education and Welfare (HEW); Had We in t eroded to apply for funding , 
froiu; other agencils, objectives would "have been adapted tb their require- 
■■•merits. 

: : The HEW guidetiries are reasonably permissive: they allow 

us to piari a three-year study, and to use. a relatively .large proportion 
of our total funding for travel (permitting site visits to each partici- 
paEing cimpup) and for salaries (assuring us of competen^t. qualified per- 
sonnel) . Cbiribining quantitative arid qualitative techniques is generally ; 
at^ expensive prbpositipri, especially if. the target of the analysis is as. ; 
diffuse as the one we envisioned— six diverse' nursing programs. Both the 
timetable and the budget, -however, seemed to allow. us ^tC-set some rather . 
ambitious bbj ectives , arid to hiri senior "research pe.rsonnel and consultants 
at the, dbctorai level of preparatlbn. . ; <( - 

■ V; ' The third inajoS restraint although-we 

were proposing to do ^an evalUatioft of a curricular model based on six pro- 
grams; we had no knowledge of .precisely what each program's own curricular 
kjictives. were. To be sure, we acquire this, bit of 'missing info^ation " 
•eaily ofc^ drir iriVe^ ^re nonetheless cbnstrairied from 

;ievising^^ures of sricc^ to specific program- goals. ^ Our 

;: scJlution is to^turri this ''limitatiori" :to our advantage. Iri.lirie with the 



phildsphy of inquiry aiscassed in the previous section, we seek to consider 
measures of achievement which are generaiiy appiicable to second step cur- 
ricuiar objectives as derived from the literature as well as from our ovm : 
ideas about such prdgrams; In a senses then, the research questions which 
we pose contain within them bur tacit hypotheses about what it sis that the 
second step model sets dUt to accomplish. 



3. Current issues 

Having been involved in second step research already for 
some years, we were well aware of the coritrdyersial natuie of this curric- 
: ular model, and al^rt to the necessity for including in our research dbjec- 
■ tives a means for addressing the central issUes and prdviding relevant data. 

The basic questions that we hear the nursing prdfessidn ask — 

'""ing are:'~^"'ei^^ 

lower-division pre-licerisure preparation? What distinguishes technical 
frdiii prdf essional nursing education? mat is the rdle df liberal studies 
in, the preparation of a pfdfessidnal nurse? Are hospital diploma programs 
obsolete, or sbduld they be? What- are the pros and cons df experiential 
learning? What, if anything^ ddes this inndvative model contribute to the 
professidhj dr td its current educational system?" 

Such questidris, appearing persistently in the professional 
Jdurrials, cannot be ignoired. Although we don't presume td "answer" them;: 
once and for all^ we do plan td gather, analyze and iiiterpret relevant . . 
■^infdrmatidri which will generate useful i'fisights and bring light intd Sdme 
of the darker corners of heated rhetdric and persdnal bias. ' 



4. Research dbj ec tiv es of the HSSP ■ : 

■We have briefly dutlined our philosophy of inquiry^ the prac- 
tical .constraints- under which we operate^ and the need for empirical data • 
relevant to the current issues surrounding the second-step curricular mddel. 
Taking all df those things into considerations we emerged at the end of the 
process with three basic research dbjectives: 
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1) " To a^^^^ describe- these £rbgrains with respect to: 

(a) Charict eristics of students; Here we consider: ~ " 

• Types of educational and pre-iicehsure preparation 

. Personal goals and professional cbinmitineht . 

. Deindgraphic, attitudinal and personality attributes 

. Measures of acaderaic potential and achievement * 

Measures of nursing knbwledge/cdrapetence and pr^ 
achieveineht 

(b) Educational pattern and milieu. Here we consider: 

. Administrative policies, including admission criteria • 
. Manifestations of program objectives, explicit and implicit 
X. . Patterns of interaction among faculty, students, administra- 

tors and health professionals : • 
, Teaching styles and curiricular designs . ^ 
. Regional^ historical and institutional contexts 

: . (c) -Types or processes of academic . and ..prof essibn 
Here we consider: 

- (how expressed; how . wi accepted; 

chariges or a^daptatTd^ — ^ - — 

• • . Faculty and adraihistrative structure (fdrmatidn, transiTionT-"- 

- . \ . - stability^ etcs) ^ * _ ; 

V Student success' (persistence, grades> ,pelf-perceptio^^^ intel- 
lectual grdwth, goal orientation, professional advancement 

■ ••' etc.) ,■ " ; , __■ [ 

-. ■ Second step cotist ributioTis td the nursing prof es^sidn C^^^ 
perspedtives/rdle definition^ ;V;titi^^ 
^ leadership; etc.) . • i • 

2) To exjpldre ways^ which these various elements are-^interrel^^ted^^atid 
the meanings df such 4relations^^ thus, to characterize boph the : 

. components and the d I ' 

3) . To fortnulite a descriptive dhd analytic raddel df - secdnd. stepT n 

. - education both for cot5P5.^isons *^mdn^ and for v 

future comparison with other baccalaureate models. „ 

D. Setting the Timetable : , pacing and checkpoints 

-r^':" ^ . . ^ NSSP ar a whol^ .has several dbjectives , only one of i/liich : 
Is theVrauitir^cmnpUs evaluation s^ -in budgeting the timei energy 

and talents of our saven-p^rsoh ( central .staff , we itiust plan,.fpr 

the accomplishment df three dther airas in addition to: carrying out, the 
evaluation: 1) a "faculty aeveiopment:;pro 

skiils of. biiV siix^^^^^^ 2^ continual provision; of repojrts 

aft^i fitidings to participating^ campuaes for their use in decisidii-making; 
ana - 3^ the ^,desi,gri and funding of another 'ir^ ear ch proposal comp the . 



second ; step t^i^^ inQdel of baccalaureate nuwini/education. 

V' In curricular evaluation; paci^^ to survival. The 

very naturToTan^'eaHca "^iii never know 

"everything" about its students, its ^^^r^^^^ 
because all three are like shifting sands under your feet; by the tiine 
you Release the final report, ydU can be quite sure that it will be 
'"dated." By taking account of historical and developitiental factors- 
trends and changes over tirae—ybu can thei^ deleterious effect 
—upon your coriclusions. But 'you can never eliminate it entirely. Pacing, 
then, means: * ~ L.r^^^^ 

1) Deciding" what the study is Vping. to actually produce in the way of 
" flportsy conf erehces j ^pres'entatiDns , publications , etc. ; 

^/2j Writirig those big events ^onto^ -long-range (three-year , in the case 
of the NSSP^ Calendar with at least an^^approxim each; ,:; 

3) Identifying those things you really need to know or to do before^ro- 
diicirig each tnain event, and what amount of instrument, construction, 
data collection, analysis and writing will necessarily precede it; 
U) Reviewing and adjusting the calendar (products and deadlines). siich 
that it reflects a Jeasonable work-load for the available personnel 
' (and budget) . ^ : 



The NSSP's adjuster? calendar looks something like this: 



July 
August 
^ept. ; 

Oct ; 

Dec. 



Jan; 
Feb. 
March 



April 
May , 
June 



Year 1 

Workshop for Evaluation 
Associate&l instruments. 
retdy for distribution; 

Program Survey Report 

- - - -- ■ 
Manual - to pmnter 

>Reports to all six 
campuses; Report to 
funding agency 

SITE VISITS 



Yea^ i 



Year 3 



De^riptive report: 
Gi;aduatibri data 



Descriptive report: 
Entry data 

National Invita- ; 
tibnal Conference ; 
Report to funding . 
agency \^ . 
SITE VISITS ^ 



National Invita- 
tional Conference 



SITE VISITS 



Publish conference Publish conference 
proceedings proceeding^; Final 

Report 



' Those are the large check .points. The catcli is that ^ is a 
continuous process--i.e., ybU also havp. to pici and^calendar the step^ 
that lead up to each 'pne,. which is essentially ^ the of the study . 
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~--^TliB basic principle f^biii all this is simply to kiep ybur inter- 
mediate goS^f irmly in place ^ arid when push comes to shove (as it surelj 
will), to sacrifice^uaritity for quality. BoS't get Ibst in the maze Of 
collecting data you won't have time to analyze, Or in endless analyses 
that ybu won't have time to inte^ret. Be reasonable. 

E. Adopting ^ Hethodological Approach ! • strivirig for elegance 

The research obaectives outlined on page 16 dictate certain 
demands upon the methodoloar: 1) the study mUst be at Ifeast semi- 
longitudinal in order to address questions of change and development; 
2) it mUS;t combine quantitative and qualitative strategies; 3) outcomes. 
- must iSciude theoretical constructs for model-buiM 
merits of goals and achievements; and A) aSeas of ctinceptuai interest cover 
a broad range, froi specific student characteristics through to ' descrip- 
tive const ei'latioris Of program charactfcfeics and their inter-relationships 

■ fecfiriically, we are coridUcting^ a comparative evaluation of six 
specific secbrid step programs. That means our approach rieeds to be able 
to.assesls'the impact of each program upOri its students, and that such - _ 
measures must be comparable across programs. Since the "impact" of an , 
educational venture is usually measured by comparing giraduate arid/or post- 
graduate data with those, collected at time of entry, and since we recog- 
nize the serious limitat^.ons of cross-sectional comparisons which preclude 
measures^^bf iridividual change, we need at least one lorigitudinai student 
sample oil each campus. And since: we assess not only "academic" but ; "pro- 
— fesional'"' competerice, our data should pertain to a relatively elongated - 
^ time span--f rotn pre-entry background through to post-graduate placement . 
and attitudes. Hence the longitudirial approach. - • 

in actuality, however, we propose tb do mO re than a simple - ^ 
evaluation sttady: we also seek to- characterize the components a^^ 
• outcomes of second step nursing education, and to formUlate_ a desctiptive: . 
and analytic Sodel of this general cUrt^ form, in metho'dological. 

tennsi this implies that data collection, data processing arid first-level 
; Statistical and "qualititive analysis should be compressed, taking place 
irisofaf as possible withiri the first two yea^, arid leaving the third year 
.relatively open for achieyirig bur "beyond the evaluation" aims. . ; . . 



Referring back to; the research objectives (page 16), _we built 
the Tnethbabldgy around the types of data and analy^ses that each seems to 
require; . : - . , ' ; 

1) To define, analyze arid describe the fdlldwingj 

, (a) Student characteristics^ - ^ 

' .f Primary rieed is ;.fbr quantitative (i.e. , objective^ ; 

. ^ ' pre-coded,: standardized) data on students, sufficient 

to characterize each student population. 



(b) Educational piattems 

...... ■ ■ / * , 

Primary need is' ' ^or quaiitative^Ci^ 

interactional, historical, interpretive) data_ on the • 
social processes ^tid ed(icatidnal climates' that typify 
the prSgraihs. 

(c) Types or processes of achievement 
Requires analytic strategies (i.e. , indexing^ fact^^^ 
global coding^ etc.) tb' defiriiB program objectives, , 
administrative structure 5 student "success," profes- 

' * sionai roles, etc. , - . 

2) To characterize both components and outcomes 

Requires exploratory methods using bdth^ stptistic^^ 

of variables and grdundeJ-thedry^ tb_identify interrelationships 

amdngrUey variables and among gets of variables. ; 

3) To formulate a descriptive and analytic model 

Requires descriptive arid theoretical mbdei-buiidirig: time for , 
' ■discerning arid conceptualizirig the ba-sic .elements of second step- 
nursing education as evidericed iri our 'data. 

- An eiegant design is one which provides all the approi)riate 

information with the least expenditure of time arid effbrt. It avoids ^ 
owr--collectiori of data, but insures that data will be available on every-- 
thing you -exged£ to need for analysis in time for optimal Usefulness;, 
allbws time arid ■ flexibility Iti the schedule fdr dealing with the 
and prdvides both time and motivation for making the best pbssible use of 
the info rmt ion. at harid—i.e., building bn previous .research, interpreting 
firidirigs in more than a mechanistic fashion, and produciritg prose tHat is 
of more than passing iriterest tb the significant audiences you ^plan to 
address. In the language of the market place, it*s getting the best return; 
on your Investment^ ' ' .* 



Notes 



Iv ' ft might be tidted that between the time we submitted the p^^ 
■ : aSa the time It was funded ^ several more second step ^ 

accredit^^^ So In reality ^ bur sarapie r^prksBnts six of the first 
*• such pirograms to receive. NLN accreditatib ' , 



Tb see what we raeati, cdtnpate .the_ second step phenomenon with a - 
"federal job training prbgra|g_such as the Cdtnprehensive Empioyinent 
Training Act. Ba^sed^^ model frbra Washingtdh, lox:ai eET^^ 

programs have been established as a .riatibnal respdnse to a natioiial 
prdblem t5f .unemployment . Each one is supposea^tb work like the ^. 
bther ^.^and goals are easily quantifiabie^ more jobs; .bet 
etqV The national pirdbiem is addressed locally, but the goals and 
the structure for meeting them are defined "at the top." In the 
case-~bf second^tepu-prbg^raras hd^ 
-from_the bo^^ as it were. ^ 



3. . Inj:ipeaking df! a "second step package,"vye;are in^^ 

foilbw^irig ideas . ; A ndn- traditional- student popuiatiopv (mostly ^^^^ 
feinalei mature, ex^ erapioyed) is responding to new , 

roles for nurses , and attending .schddls- which in the past might not 
have made room" for them. The programs at;! radlded ndt only^by the 
: hew prof essional nursing they must teach, but by the new 

ni^ds a^ these mature students. And ^ not just any 

faculty cati tnake the transition to^this new and expanded professidti- 
alism^ abahddning familiar: didactic techniques, for: 

■ ' collegial ones appropriate td, say-, a forty-year-oid raoth^ 

who has been a staff nurse for. 15 years. new programs ^.^^ 

reasoned; are designed to: address a tiew' kind of $tude^ 
atid^^must be taught^ new rbles^ by a new kind bf faculty. Each part 
. of the ^"package" makes the others what they are, arid ribne exists in 
isolation. 



• 0 ii'^-*',:. 
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. : „ ..... " . CHAPTER III ' 

SETHDDDLDGY: A Plan to Get From Here to There 

The cSdnduct of research, regardless of whether, it is a cdnipre- 
hensive program evaluation or a harrowiy focused experitrental design, is : 
basically a process of itfaking timely and informed.dlecisions and then "follow- 
ing' through." The better the decision-making process, the soother the road 
wiir run; the better the quality of the decisions made, the more fruitful 
the results pf the inquiry. ; 

' V r /in st)ecifying a methodology,- we take eacfr oi the "types" of . 
variables and analyses required by the design and move' on to t^ next level 
bf decisioh-iTiaking. Exactly what do we need to know about students, faculty * 
environment, course Structure, and administrative" policy? 

■ In this; chapter, not the dicision-making process but 

the results of tha.t process: the; sbur^ of information and why each has - 
been chosen;- the dat^ ga techniques we employ and the 

functidils they serve; and finally, a few words about the timetable for^ . 
accomplishing intermediate goals ^ .arid about staffing the overall research 
■.effort.- '■ . : - 

A; Sources of Information " ' , 

■ ' ■ > . ■_ . . . ' . ■ 

§ur methodology specifies six ba'sic sources of information: 

1) ; students (which also includes graduates)., 2) gradHafe^sV iminediate super- 

visors in empio]^ent settinpT~^3^^^^^^ Evaluation Associate, who has; access 

to departmental records on each campus, 4) other nursing faculty members 

and possibly soml nbn-ntirsing facult^^ courses 

from other disciplines, 5) program admriistrators, and 6) -the NSSP staff. 

What remairis, then, is tb; identify what information we obtain from each 

source, at what point in the calendar such data can be most efficiently 

cbllectedr and; by t^hat means ^ "What" and "when" will be discussed iri^thiG 

.s^ction.> "By ^at means a discussion of . specif ic data-collection 

in struirients arid techniques — is reserved for the following section. 

i;:, ' Bata frbm students 

. Clearly, most infbrmatlon frbm s.tuderits is bf the "self-report' 



variety— i;e;; their responses to questionnaires and surveys ; Such ihstru- 
merits- are constructed not only to iticit- Relevant facts about their back- 
grbunds; but also to Rfbvide; the major source of attitudihai^data and a 
view of each ptograra as a whole from the student perspective. Irrbr.der.to 
support, validate and supplement those seii-repbrts, however, we also 
collect "objective" measures bf the student population: measures of gen- 
eral intelligence, bf specific nursing knowledge and cbmpeterice, and of 
personality dimensions. Four waves bf student data are scheduled: at 
entrance, in schbbl, at graduation, and post graduation. 

...Next question: which students? With a total data-collecting 
period of. less than two and a half yeafs (leaving the last six months to 

work with a completed data -base) ^ it -is- bbvlbUS-that- :on±yrone;ientering__ 

class^can furnish tirUe longitudinal data, from entry through tb post- _ 
graduate placement : ^^students entering the prbgram with- Junior standing 
at ihk beginning bf the Fall term. Year 1. But thinking ahead to the 
sefibus problems of sample attrition in Ibngitudirial studies, we supplement 
various se'inients of their respbnsei With data collected from other classes 
at parallel pbirits in the program; ' r 

Entry-level. data, for instance, are strengthened by adding 
tb our respbndents those Juniors who matriculate in the Fall of Year 2, 
altfiough: we "do not "follow" them through to graduition. Graduatibh and 
"in schbbl" data, on the-other hand, are similarly strengthened , by survey- 
ing thosi students who entered each program one year previous, to the ini- 
tiatibn bf the study, and who theoretically graduate at the end of Year 1. 

Post graduate data-collection is traditionally the weakest 
link in Idngitudinal studies of student groups. Potential survey respond- 
enti ire scattered- geographically, no longer accessible through ribrmal 
campus cbimtiunications channels, and no longer psychblbgically attuned to 
the. needs of faculty and/br departrdental personnel; At the_ same time, and 
especially fbr the NSSP: which, se^ks tb assess "prof essibnal" as well as 
"academic" achievement, it is .a crucially important phase for purposes of 
assessing prbgram impact. Therefore, we add not bne, but three cohorts, 
of graduates to the target sa^iple fbr pbst-graduate data: those who grad- 
uate at the end bf tear 1 (and who are referred. to in the previous pata- 
graph) plus students fiom the two preceding clashes who are already "in 
the field" as bur study begins. 

■ -''22 ' ■ ■'. '. ' 



The rather coni^lica ted data-cbiiectidti schedule "which results 
ftora adding all these ±i presented below in graphic 
fbi4* where entering clasie^ are niirabered chrdhbibgically and where:/ 



bi is the entr^ battery. ^ 

02 is the "in school" battery 

03 is the graduation battery 

is the post-graduation battel^ 
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*Class A ±s the basic longitudinal sample; ail 
others are supplementary. 
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2. Data from supervisors 

Most of these dat^ are "about" program graduates, but they 
perceptions of a small non-^random sample of supervisory per- 
n the nursing profession. A hrief questionnaire is mailed to 
the immediate supervisor of each graduate who provides us with a riame and 
permission tl) cdhtact that person. The data-cbllectiori schedule, then, 
coincides wii:h tfie post-graduation battery (O4) as outlined above. 

Since these supervisors constitute, an extremely heterbgeriebus 
pdpulatibri, Je alsk ask them to tell us a little bit about -themselves, Such 
as. their own educational backgrounds, how long they have known the graduate 
^c. ■ Th of the graduates' personal qualities and pro- 

fessibnal comUtencies can' be interpreted i^ the light' of those few 
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iself-descrlptive items i . ■ ... _ - - 

• 3. Data f tbin Evaluat4oft ^^sioctates 

. ' As mentioned bri paie 21 
campus repreaent s our direct acciss to the hbri-conf ideritial information 
contained in departmental recb'rds. Their largest and most important con- 
tributions tb the data base are to define (and then keep track bf) the 
various samples, faculty as well as students, and tb distribute: and Collect 
the various data-gathering instruments throughout the study. 

The student samples that they prbvide not merely lists 
of names . They 'contain also . spectrum of background and dembgraphic 
variables that are accessible from applicatibh fbnns, transcripts, etc., 
insuring us of at least some data bn all students which is not of the self- 
report Variety. Most of this information is originally compiled during 
Year 1, with elass 5 being added at the beginning of: Year 2. 

.In addition, the.Evaluatibn Assbciates furnish all "academic 
proireis an^ but come" variables by continually monitoring and recording 
grade-point averages and changes in enrollment status. Who is still - 
enrolled? Who has a leave of absence? Who wij-l graduate at the end bf 
this term? 

4. Bata from faculty* ■ 

Although faculty samples furnish a limited amount of quanti= 
tative data (e.g.. ^ persbnality and environment inventories as well- as 
responses to a few pre-coded questionnaire, items) , their contribution 
consists primarily bf qualitative data--ppen-endquestionn items and . 
interviews; From their words, we will abstract .a picture of each program, 
froi the perspective of the teacher/cpunseior. Faculty respondents alsb 
help us tb define student success by selecting frbm each list of graduating 
seniors those that they consider tb^ be the most outitanding nurses. 

.' Most faculty data are coiiected .d 
Fall and some. in' the Spring. Nbminat ions of outstanding graduates from 
Class 4 are, bf cburse, made/in the Spring of Year 2, after the Evaluation . 
Associate hai compiled the list bf; prospective graduates . from that, student 
saihple. 



■ --5 > ■ Da f fbtn progcam admlnt " 

In a sense i this is a sUb-sample of the faculty, since few 
second step prbgraras boast^a full-tiine non-teaching adinihistratbr . In 
addition to otlie? information requested from f acuity, however, this small 
; group ifuraishes^^^a^ interview data pertaining to leadership styles 

ahd., behaviors. These interviews are conducted in the Spring of Year i. 

' 6. Data from the NSSP staff 

Two members of the research staff inake ^ rounds of all . 
six programs in the Spfing tena of e academic year. During, these site ' 
visits, they conduct* interviews (whlch-is^actually-^ 

other people j ,: but they. also directly observe, and experience the educa- 
tibnai envirdntnetit that each program creates and inhabits. Using an almost 

anthfopblogical approach— they^ provide raw data--in-t:he--f orm-of written : 

observatioris vknd field notes as well as "artif acts"~dbcuments , student 
reports, nei^s^ape^ clippings, syllabi^: speeche^^^ thetn 
as useful in helping. to disfine the essence of that: setting. 

in designating these six sburces of information and what we ^ 
particularly seek from each, our* intent, has been to include the "necessary" 
and to exclude the tnerely "interesting; 'V Adra^^^ we f ound^uite a lot - ; 

to be necessary^ given t1^^ scope of our research objectives. But in select- 
ing and constructing the data-cbllectibn instruments described in the next 
section i we strive tb gather from each source only that information which 
that particular source is most uniquely and most efficiently able to supply. 

B. Bata-Gathering Tools arid Techni^Aie& . , 

' This step represents the process of dperatiorializing ail vari- 

ables of interest; that is, of moving from, for instance, "facts about 
their backgrounds" to "which specific facts," or from "professional and 
academic achievement" to those specific variables that can define such 
achieyemerits.. Seventeen ins techniques cdttiprise the mearis 

by which all iriformatibn is gathired from the- six sources outliried in the 
precWdirig sectiori: four -types of standardized' tests, twelve prbject- 
designed instruments^ and the -limited use of observation 



i; . Standardl zed tests 

Four objective measures aire cciitrai to bUr research needs: 
personality diraen^iqnsi nursing .JcnOyledge; overaii intelligence and p^r- - 
. ceptions of theVacadetnic environment Standardized instirUinerits selected 
to' answer those needs: are described below; rfeferepces will enable the . 
reader to oTjtairi copies, and fiirther information concerning their Use. 

a. Omnibus Personality Inventory (OPI) , 

•- V Designed specif icaily for use in colleges ; and univer- 
sities , this inventory assesses • values ^ attitudes and interests relevant i ^ ^ 
to noTmal~funl:ti6mn intellectual actmtTTin'such^^^^^^ 

and Yon ge, 1968) Fourteen scales represent personality dimensions impor- 
tant in understanding arid ditf ereritiating among students .in an educational 
context. The profile produced by the OPI cari be Used to assess intellec- 

■ tiiality. sbcial and emotional: maturity, flexi^ and 

other related characteristics; ' . 

' .. : . our use of this instrument steins from two liries Of 

reasOriing. First, there is little doubt that personalifcy characteristics 
have played a fruitful role iri riursirig education reieafch in recent years, 
both descriptive and predictive. Summing up a major review of the 1965-75 
literature pertaining to the predictiOri of successful Sufsiiig iractic^* . 

' one irivestigatbr coriciudfed that ''t^e 'flavbr' of the firidlrigis 1 suggest that 
better nurse performance seemed . to be associated with What might be called 
a mature personality structure . (Schwirian, 1975, page 12) Second, 

in bur previous study of a singlesecOrid step .program, the OPI figured 
promiri^ritly iri th^ deliiieation of _diinen^^^^ of success as well as in the 
I insightful descriptions of botjh studerit& arid faculty; (Jakq et al., 1978) : T 

Since pre-pbst scale scbres are very appropriate for the 
; ineasurement of Hhaiige, this test is. administered to our longitudinal student 
; sample, at eri try arid agairi aS graduatibai Faculty members also complete 

the.bPI; Opr iise of this instrumerit,theri, yields sets of individual per- 
• sonalityp^ :which can U statistically c bbtairi aggregate , 

or "ffieari profiles" for each participating program (separate pr,ofi±es for 
•ficBlty and for student groups) as well., as pemitting statistical compari- 
" soh^I'Mong various sub-sets of respondents. 



b; National League for Nursing (NLII) ^ 

] * llie National League for Nurs^^ (10 Cblutnbus Circle, 

New Yorki NY 10019) makeS available a broad range of achievement tests, 
many of wHich ar^ more or less relevant for assessih competence 
in various areas of nursirig- knowled the enthusiasm of most student 

samples for completing sUch te^ research purposes -is, to say the • 

least, severely, limited. Accordingly, we selected only twq of these tests 
to provide standardised measures of achievement in: the field* of .^nursing: 
Community Health arid Applied Natural Sciences. The former is an area of 
major eSphisis ; in many; s and the latter disciplines - 

'ftre"^fr1>bv±b^^^ those witli 

a physilcal. assessment emphasis. " 

The two tests are adiSnistered to^our longitudinal student 
sample both at entry. and : a 
.measurement of change sdoring ^ distributions ^cah be v 

averaged to" characterize each program in terms of these cbinpetencies. 



c. 



The Catteli Cuiture Fair Intelligence (CFI) Test 

. , Two. primary considerations influenced our choice of this 
instrument (Scale. S; Form A) , which is admitiistered to student samples 
only at entry. First, it is brief, requiring a half-hour or less of timed 
administiration. Second,* it measures basic intelligence in a manner designed 
to reduce as much as possible the ef^-cts of verbal fluency, cultural back- 
ground and educational level. (IPAT, 1973) 

Certain problems, however, ^are associated with using the ♦ 
CFI on samples of studeats who .are older than the traditional college-goin^ 
population— i.e. , those who are jpast their mid-twenties. This is partic- 
ularly relevant^ for NSSP use, since the average age of students in second 
step programs is about thirty. In order to correct , for' this, authors of 
the instrument suggest a simple linear age-correction- procedure. Howeyer, 
further research based on more recent and comprehensive results from the 
CFI (Barton, 1973) suggests a refinement of the age correction which has 
been adapted for use in the" interpretation of NSSP results.^ ' , 
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;d/ ;N\itsing . School Environment inventory (NSEI) 

This test, adMnistered to both faculty and student- — 
samples i provides perceptions of the general ehvirohmeht bf'each program; 
: (Johnson; 1976) , eonslstlhg of sixty-rtihe iteiiis, it yields six Scale scofes 
the original intent of which were, to distinguish the environmental differ- 
ences among AD; diploma and generic baccalaureate schools. . Normative data 
are available for these more traditional;;types of nursiSg programs. 
(Lysaught/l97i, pages 313-318) Thus with the NLN achievement tests, 
findings can be used not o^ily... descriptively and for comparisons-^ among the 
par ticipatins prbgrains themselves, bur iisa-_tas vl perceived enyiron- 

ments of second step, programs in comparison with those of other nursing 
pro g^aSs with more traditional curricula. This tool is self-administered 
during the Fali; term. Year 1, to faculty and during the Spring term. 
Years l:-and 2, to students completing their , first year in the program. 
It helps to define a school profile for each campus, and to determine how 
eHVironinental scales may characterize second step programs and/of dlstin- 
gtiish them from other nursing education models. 

-2; Pro.iect-designed instruments ^ : 

/ As mentibned on page 25, twelve iristrumehts were designed 

specifically for usi'^^^^^ Nine were constructed to gather addl- J'^ 

tional information from (jr about students; they are described in roughly 
cbronoiogical order, beginning with the data sheets compiled by each . 
Evaluation Assbciate and concluding. w^ post-graduation battery. 

Thre^ shorter a^^ tools were designed to provide addi- 

tional jinformkt ion about the programs from the perspectives of faculty 
and administrators.. •< ^ 

•' Each instrument has its own purpose and rationale^ and these 

are discussed one by one; Since it is unlikely that the NSSP research can 
or should be replicated in its eiitim our debate as to whether or not 
to reprint the tools themselves for inclusion in this manual was decided 
in the negative. However, copies of specific instruments will be fur- 

-i ■ ^ 2 . ■ 

nished promptly upon request. - ■ - 



a;' Evaluation Associa^^^ (EADS) : Fbttt A and Form B ... 

These two forms furnish what are essentially glorified ; 
student sample lists as compiled by the Evaluation Associate on each carapuSi 
ffiey cbntaih^ C b^sic dembgraphicrand educaHona inf orraa- 

tibn bn every student in the sample obtained by drawing upbri transcripts 
and other departmental records. - ; _ 

* • - The first. Form A, lists by "ciass" (date of entry), each 

; student who matriculates into the upper division, omitting only those who . 
withdraw pribr tb the end of their first grading period. A long (11" x 15") 
fbtin, it pro^^ one line of data fbr each name, including: 

1) General . Itiforinat ion iiL^ ' - i ' . ' * 

. cuirrent address 

. - . date of birth 
/ race 

. class level at entry (usually Junior) ' 

2) Preparation for W stite boarHs^^ - :: — 

"V - riaine^ location and t^^ . ^ 

' • tnpnth/year Icirst enrolled . 
• ihbrith/year; cbnipleted^ - 

3) Whether of not student attended any othe^ pdstsecoindary institutlonCs) 
prior to enrbiling in: second step program (yes or no) . 

4) Academic statistics : v / ; ^ . 

. at'' time; df entry .'^r : ' , - 

' . un^ts previously eairned 

- • . units successfully transferred (applicable t^ard BSN) 

. CPA at; entry 

I at end of first term - , 

, . . units taken 

. first-term GPA _ 

. at end of data-collection period : - ._^,^::_^^:''^\_'_^-:^'_^[ 

. date_?of withdrawal or graduation, if applicable j: 

; . cumulative GPA — 



The second, Form B, lists only those students who attended 
oTiB or ior^ post-^second^ry ins:titutibii^:;d^ addition to the one listed on ^ . 
Form A (i.e. , source of basic nursing preparation). It provides ^dre. details 
^on the. e^ucationar histories of these students^. ] j - 

in practice^ the EADS ^are- di^^^ time consuming to 

cbmpletei Transcripts are hbtbribusly difficult^t^^ and interpret, 

arid are bft^n* simply not avaiiabier Even when academic records are 



meticulously maintained^ the great variety of systems by which educational 
•ihstitutibris recdrd their .students' progress (e.g.^ defihitibhs of credits, 
units, grades i etc.) make accuracy arid ihter-prdgram consistency almost 
impossible goals. ' Nonetheless, the EADS, provide the basis for clearly 
delineating ari^ minimally characterizing all student samples. 

b. Entry Questionnaire/ 

,^ This twelVe-page •^instrument contains 61 separate items; 
it is the basic source of all self-report data from incoming students. - 
Some items request simple factual inf orTnatibri--educatidrial and family 
background^ living arrangements, a coraprehepsiye review of previous work 
experience, ett. The vast, majority of the questions, however, are 
designed to tap the attitudes with which students enter second step ^.pro- 
grams. Reflecting again the breadth of the NSSP research objectives, 
these items range over a great variety of topics, some of which can be 
illustrated by a few excerpts from the questionnaire. . 

Attitudes toward. education in general and nursing edu- 
cation in particular are of obvious interest. Some items along these 
lines include ^ 

• How do you feel about competing with other students fbr grades and recognition? 

- ■ . 1. I very mici; dislike It and prefer to avoid It 

" 2. I dlslljc. it. somewhat , :• 

■ ' . .3. I have neutral feelings about this . - - : " 

• - 4. I like it soriewhat 

^ --^ 5. I like it very niuch • . - . ; ^ ::::: : 

• Have you decided iipori a field of specialization within nursing? 



1. 

2. Yes (What is it? 



a. How definite is this decision? 'J: 

• : '. ■ ■ ' i. Somewhat tentative * " C 

' • .2. reirly definit^e-ri \ 

' 3. Very defihite ' " 

When:dld you decide to get a baccalaureate in Surslng. and what ^ere your clrcamstances at that 
time? ■ " ■ — ^ 



a. For what reasonCs) did you decide to get a baccalaureate In nursing? 



f For what r^^asons did you choose this particular liutsing program? 



• Do you have any e 



piciil expectatiofiB of the nursing prbgram in which you aie enrolled? 



1. No >; 

2. Yes (What are the>7) 



Many^ items pertain to the respondent's participation in 
and perc^tioh of nursing as a profession, such as: 

HSv Tnuch Interist db you pt...ntty have in the following areas or nativities'' of nursingr . : 

(Please respond to the following categories.) , . . .V*^^ 

Littlior Some Much 

KO Interest ^*^W^t . 

^ ^ : . ' -■■ ^ . : 2^.™-™ 3 -— 4 .——5 

Belonging to a state or national nurses' j _ 

organization such as. Che ABierican Nurses . . ■ ' _ . — — , — : ^. — 

Agsoclatlon or a state affiliate . ' , , J 

Reading Korsing Research or other nursing ./ . ' ^ ^ 

journals 

Attending meetipgg or workshops related to ^ — 

nursing br:to the health care professions 

Doings researcji connected with nursing or --- - !l 

healtih care ^ t : , : 

Writing Articles related to nursing or . _____ ' ' •. " ■ 

health care 

Acting as a resource person to new^ ■ ' ; : : 

licensed nurses oi to other h^^^ 

Acting as a leader or cpordinator in inacte . - . ^ 

connected with nursing or the health . field ~- ^ 

, ' Union activities related to nurtting . ' - - - ,. ; /. . ' : — i 



Do you currently belong to any professional nurslhg organizations?. 



1. No * . 

• 2. Yes Which ones? ^ 



Have you ever held any offices Br served oa committees in i professlBnal narsing organization? 
(Check all that apply.) » ... • 



No, neither • . / 

Yes, have served on cbmniittees " . — — V- 

Yes, haVe held office " ; — r 



How much of a personal stake do you^ f eel that you have in your idehtity as a professional nurse? 
: ■ ■ . ■ 1. Not much; 1 work as a nurse: When I'm employed to do so, but I have no particular 
f feelings abbiit beliig a memter of the nursing profession. .__ 

• . • 2. Only Soderate; I think of mysilf is a nurse when , I'm on the Job, but it s not an 
idehtity I carry with me into other aspects of my life, ^ = 

5. Undecided; I jjo back and forth between "^"Z" and "4". . , 

• - 4; Considirable; a nursing career Is Important to me at present, although I may decide 

later to move away: from this field. ^ _ _ ^_ _ _ _ ' - . _ _ - 

■ ; 5, Very great ; . I like ta think of myseU as a member of the nursing profession; and 

maintaining that identity is very important to me. 
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A handfui of items have some relatibhsh:^ to respoildent'is 
attitudes toward sex roles ^ such as marriage plans, etc. Two of the more 
explicit items are the following: 

* Traditional rolei tor ren and : women : In our society (I.e., Sen as P'°*"^",.*"'' " ^^^^ 

mothers) havi received a great deal of crlttctsm In recent years, and the "women sm^veraent J^M 
b^eh widely publicized. From the statements below, choose the onfe Which best reflects your posl- 
tioiii or add your bwii, 

1 There are many good reasons fo^ the socially defined roles of neh and wbneri^^ 

and. emotional as well as historical, .For both sexes, traditional roles provide a 

^ measure of fiiiflhsQent, security and satisfaction; they should be maintained, 

: 2. I have no. strong feelings about the way men and woTn^n_ire differently defined ^ 

~ treated in our society; ah Individual Is free to create his or her own role without 



any major s^.cial change. 



3, Undecided or no opinion, ^ ' • 

A, Won:en arc economically disadvantaged in our society. They shSuld receive equal pay 

' for eqpal work, and chlld-ca?c when needed, Ecdnbnilc dlscrlmlriatlon is my major concern. 

5. .1 am very concerned abcut many aspects ef the differential roles of men and^omen. Mal^ 
chauvinism is damaging to both sexes; It should be understood and eliminated from society 

6, Other? (Please. 'specify.) \ 



#/ Do you think the women's movement has' had any effect on your decisions regarding ybiir nursing 
career? 

1. Noi_I^am unaware of any effects on me 

2. Perhaps, but I think its Influence was quite small 

3. I have rib Idea 



3. 1 nave no laea - ■- — - 

4 Probably, the women's robvenient did have some Influence on my decisions 

5, Yes, my decisions regarding my career were definitely Influenced by the women s movement 



Asbefits an evaluation, we also incl^^ several questions 
aiinea at learning' the respondent-'-^ own self-perception of abilities and com- 
petence. i For instance: ^ • ^ 

■■ • . ^ ■ 

* Below are several Intellectual skilis which my be impbrtant_ in any field of study, Kegard^ 
bf the number bf courses :you 'have had^ jplease Indicate how much competence you already have t» 
achieved in the nursing fi.eld," 

tittle Some • Much 

Knowledge of facts arid specific Irifbrmatlbii __ ■' " ' - 



Knowledge of gerieral prlriclples or theories 

Ability tb analyze and evaluate books and 
articles . ^ : ' 

Ability to apply knowledge In specific' 
- situations outside the classroom 

Uriderstaridirig the methods used in nursing 

Ability tb cbmrniirilcate knowledge to, other 
persons 



# How would you evaloate your cbmpetencS to serve in each of thcae rolei often encountered In the 
Sealth fields? - ' Not Somewhat Highly 

Qualified Qualified . Proficlefit: 



Team member 
teani leader 
Consultant * 
Individual practitioner 
Teacher 

Adminifitrator/Planher 
Researcfier 



Finaiiy, we wanted some idea of the future perspectives 

with.whfch students enter these baccalaureate programs^ Although several 

items ^approach this more subtly, the two concluding questions are perhaps 

the most" illustrative: ' ' <r 

" , ^ a ■ 

9 besfcribe tjriefiy. the position you would like after graduation. (E.g., "head nurse on 

Che pediatrics ward in a large metropolitan hospital.") ^ 



• What are yoiir long-range plans for a position in nursing? 



With a questionnaire. of this length, there is some danger 
of alienating (or simply exhausting) the respdriderit^ and' we were not unaware^ 
of that risk. However, by making the^ questions themselves both interesting 

• _ ■ _ ■ T(_ _ _ ■ : 

in cotibent and simple in ^response format, we offset the dis'advantage of 
length arid obtain relatively complete and, useful data from those who respond. 

c- Second Year Questlbririaire ^ \ 

■ ff 

if .you remove all attitudirial items from the Entry Ques^- _ 

tionnaire^ what you have left is' a brief two-page form that contains only . . . 

18 separate questions. The title, Secpnd Year Questibririaire, indicates 

that • it is administered drily to Glass - 3~student:s who "are already- beginning 

their "second year" at the time df dur first wave^ of data collection. 

^_ i f . . - --■ - -_ - ■■ -■ ' — -'.-3- 

— ■ The real function of Class 3. is to supplement our gradu- 

* : ■ _ : . J _ ./ _ ■ ......... . . . 

ation and post^graduatidri data—thus they will cqnipiete the entire battery .< 

df instruments at those times i But since they are ridt "eritrarits" when the J 

■ \ . . * . , _ : _ _ _^ _ _ _ _ _ ■ . ■_ \ _ J ^_ j_ - .. ■ __■ y 

study begins, attitudinal data from this; sample would ;serve no usefbl com^ < • 
parative function in the research design.' This ; iristrUmerit , then, serves 
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merely to Increase the humbey of" students for whom we have tnbre complete 
backgrbutia data than the EADS provide,. ' Of particular interest are the, 

foliowiiig items OH' previous work experience^ ^expected^ to provide key vari- 

' _ ■ _ . ' _ _ . . - . _ . . 

a:bles in defining the distinctive mature of the second step student. 

* *^ ~ ' 

• 'Aow many rnohths of nursing experience did you have-- 

i. BEFORE receiving your R.N. certification? (cKecR'^here — If hbiie) 

. Number of mphths _ . 

Fall-tltne* Part-time* * Type of nursing experience ; 



ybluntccr _^ _ 
Salaried aid :vork 
Other health-field work: 



b. — AFTER receiving your R.N. certification? (check here ^ if none) 

Ninnbsr of mOiiChs 
Full- time* Part-time* * Type of nursing experience ; 



Staff tiiirse In hospital or Inpatient facilities 
Head purse In hospital or Inpatient facilities 
Supervisor In hospital or Inpatient facilities 

Staff tiiirse In clltilc or butpatleht facilities . 
:Head nurse In clinic !or outpatient facilities ' 
Supervisor lii clinic or outpatient facilities 

Office nurse ; 

Other (please specify) . 



*Cdiislder 30 hbiirs/week or more as "fiill-tlme" 
**Considcr 29 , hours/week or less as "part-time" 



What -vas the sost recent nursing posltlon you had . held, prior to entering the baccalaureate 
nursing prbgram In which you arg tibi^ enrolled? (teave blank If ''nbtie. ") 

Position (title or brief- description) _ ■ ' ■ ■ ' ' , 



. - . „ . . ■ j 

Employer (agency* organization, etc») ■ ' - ■ ' . ' . • . ■ :! ' . 

Approximate number of hourtf worked per weekr - - . ' : / 

Approximate salary before taxes i deductions i etc. : $ - ' per ■ - "• " in 19_^ • 

d. Fir^t Year Survey . / / 

This fpur-paga survey is given to student^ Searing the 
completion of their junior (or' "first") year in the prbgra^. It is designed 
to accdihpany the NSEI, and to clarify the students' view of the school / 
environment atid setting as well as to as partiitipatibn in and 

views iihdUt their nursing pr We'ask, for instanc^,- about distances 

from home to ciasSi, and time spent commuting; whether ^r not a "group spirit 
existed among nursing students; and about the relati&riship of their depart- 
-mint to the campus as a wholes To reflect the impact of that" first year ^ 
we^ included the fblldwing: - / 
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• What has b^eti the iiost valuable this past acaaemtc ye^r for you? (WKy?) ; 

• What has been the iea^ for you? (Why?) 

•Have you developed hew perspectives about the profession of .nursing this year (e-S-* the role 
of liurses, attitudes toward different aspects of nursing, etc.)? 

: ' i; Kone at all Cbmraents: 

:2. :.A few " ; ' . . ' • ' ' " ^' ■ 

- . 3* A moderate amount ; ■ - . -;: : 

. 4> Quite a lot ^ 
■ ■ . . .5. A 'great; deal' , . , • ' ]• . 



j f f|P^attitudlnal items are re peated f rbin the - Entry Ques-:^ 



' tionnaire in order to .measure early change in these attitudes'. Students 
complete this survey while they are in the midst of their educational exper- 
ience rather than **be£b^e" or "after." Our intent is to capture their feel- 
ings during the couraie of their studies and to discern tr^iids in the data 
they provide. .. . ; - 

; e. ; Student Group Discussion GuiHe 

. This represents another way ^bf' capturing student reactions 
during the period of erirdllment. ! Since vindividual student intetviev/s are 
not. feasible during the crowded site visits to each campus, the . only way to 
•hear directly frptn a relatively large number of students in any detail is 
to talk to them. in groups. ^ This: procedure serves somewhat the same function 
as would regular interviews with individual students, but with certain addi- 
tional advantages as well as disadvantages. , * • 

cv : - . ..Ori the^ positive side^ the respondents react not only to 
the questions posed by the interviewer but also to answers given by fellow 
students/ providing, the investigators with additional information about . : 
the. topic under discussiori as well as a chance to observe student inter- 
action in a relatively informal setting. Important clues as ;tb attitudes*. 

! values ^ and behavioral norms may emerge in addition to the informatidn 

' . . _ ■ •* ~^ ■_ _' ' _ 

directly^ requested/. The major disadvantage is the loss of privacy for each 

individual respondent, which may strongly influence the way in which certain 

-qaeiBops are answered. In. a sense, students are put in the pbsition of 
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making a '•public" statement; c6 the topic rather than of confiding 

a privately held bpihiori to ah ^.titerested but anonymous listener. The 
"(iiii^u¥^idii guW^^ an eye to maximizing the advantages ■ 

and. minimizing the disadvantages inherent in this research technique. 

The discussion guide was cbristructed around five topics: 
.15 Lateral rbles: what RN students'do besides going .to school . 

2) Student/faculty interaction, in and outside of classes 

3) 'Teaching styles and abilities in the Nursing Departraeh 

4) Curricular; content and the "place" of non-nursing courses 

5) Professionalism in nursing . 



The usefulness of the data gathered through the use of 
this instrument, as with any interview, is highly dependent upon the skill 
of the interviewer. It is also affected, by the size and cbrapbs.ition of : 
the group. Too large a group tends tb enhance the effect of more assertive 
and verbal students, and stifle, those who are less so. A grbup of seven to 
ten students is large enough to: include a variety of perspectives, yet hot 
tod many for full cowrauhicatidn. Each session is tape recorded ^ freeihg 
the researcher from the constraints of copibus hote-^taking .in order to 
concentrate- upbti guiding' the discussion; . - 

f; Graduation Survey. ' - 

Most questions on this ten-page survey are repeated 
from the Entry Questionnaire in brd^r to assess attitudinal.^^tability and 
chah|e. ^ Ih addition, however, we build a retrospective "student evaliiation" 
component into this instrument, askihg graduates to judge the effects o^^^ 
the nursihg prbgrara on their competencies and to indicate hbw they have \ 
changed during- the course of their ehrbllraeht. A few illustrative items : 
mights include the fbllbwing: 

• Re^^rch reports show th^t sttidents change in differenc ways and varying -degrees during_thfe 
coiiiS v^rs^ some report changes in their interests and attitudes^ . 
coniif^entr some sp^^^ ^^^nges. Looking back^over your own experience 

in this program, what have been the most important changes for yvj. 




f How important for your ovm^ eaucatlbnal development: have the following experiences been? . 

; : Not .. . ' Somewhat, " _ Very . , 

: • . ■ ' • : - • ■ ' ^Important - Importan t: Important 



a. 
b. 
c. 

d. 

. f. 
h. 

i. 
j. 

k. 
1. 



Lecture x6urBeB_ in maj or field 
Seminar courses In ma j or fie Id 
Clinical experijences in major field 



Courses in.otlfir fields 
Interidlsclplinary courses 
Independent study courses I 

Informal discussions with faiculty 
Inforkat- discussions withr' students 
InfonHal Individual study, research 

Reading Iti; connection with courses 
Reading independent of courses : 
Field work, in ^the community 



• Please indicate whether you fiil ybO've changed In tW^^^^ you first enrolled in 

> rKtfi program.-. Fd check the appropriate response ^ 



Deer eased 
. Much 



Some 



Little or No 
Change 

' ■' 3 ■ 



Some 



Increased 
Much 
5 



Eeiigibus .cbhcernc and beliefs 
Political concerns or interests,, _ _ 
Intellectual interests ift.yoor field 
Intellectual interests In general ^ 
' Esthetic Ihterests - 
The firmness of your sense of Identity 
Concern with. social issues 
Concern with prof ess Ibhal Standards 



g. Faculty Notninations , Outstanding Graduates 



At three points in the NSSP calendar, all/ nursing faculty 
froin the partii^lpating ^rogr^ are asked to select ^ ^,rbin a list of . the 
carrenr'iradF^ consider to be the 

butstandirig tiUtses in- that class- The first request is made as the study 
beiins, and pertains to the most recent gr#duates~Class 2^ Nominations 
from the next two classes are requested at the end oj the Spring terras^ 
Years 1 and 2. . ' ^ ? 

s The fom in which' this request is made does, riot specify ^ 
•ttii tfiteria. by i^hlch subh judgments are to be made. It simply lists all 
students; in bur study sa.raplev^or* that particular program v/ho v/ere gradu- 
ated at a certHn tiSel/'asks the.fa^^ respbrideht to "underline the names 
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^df thdse who are, in your dpinioni the dutstahdihg n this groapi" 

ana i^^^^ of hailM te underiitied (eqnai to fifteen per- 
cent the tbtai-nuitils 

: :- h. Post-Graduatibri Survey ^ < , ; 

All students In the combined samples who graduate prior 
to the- end of the data collection (i.e.. Classes I through 4) are asked 
to complete this brief three-page survey. It is administered by mail each 
Ndvembir; thus j the amount of time elapsing between a student's graduation : 

the cOmpletlOvi of the survey can vary considerably—a fact that will 
be carefully considered in analyzing the data it provides. 

Items are designed to pertain tb three areas of research 
interest. Gur primary intent is to collect factual information as to the 
career patterns bf seCbnd step program graduates. Samples of such items . 
include tlie following: 

* ReBardlcSs of your immediate en>ployment situation, do you consider yourself, at present, to be: 

1. In the field of nursing 
-■ 2. nor in- rrurslngi but ^tlll .in t^^^^^^ , ^ - ^ 

37~ ndrin hurslrsg or Health field presently, but.expect^o get hack " /"L 
— a; not iti nuranjor health field; don't expect to return to either In the foreseeable 
■ future ' ' ' ' . ; • . 

• in which of the following ateas are you wbrklhg how? (Check all th^t apply.) 

Direct oat lent care 

Supervision of patient care 

Administration^ planhiiig, mahagenieht 

• teaching (nursing relied) 
• Research (nursing related) . . " 

Other (Please specify) ■ ' ■ ' ' ^ • — 



Now go back and circle the chedk that repteseiiCs SosC of you- time and energy nbw, 



imat.l's you? curient eiDployment situation? (Check one, and Indicate number of hours when 
api^llcable-»)_ 1-- - ■ ■ : — — ; ' ' 



1. Full-time wage-earner, regularly employed (_ 
2i l>art-time wage-earner , "regularly em^ 



hours per week) 
hours per week) 



Zm Zart-Cime wage-earn ci , tc|suj.a*.j.jr v^^n^^x^j^^ ^ _ _ _r ~ ' , __ 

3. Wage-earner,' not regularly employed but work_ an .average of about 1_ hours per weeK 

4. Self-employed, currently worW^^ of about hours per week. 

5. Funded^ graduate-stadent fon.scholar^hip, fellowship, etc.) . 

6. Not employed at present. (Includes students without funding.) . __ _ _ . 
'7. Other: (Describe briefly^ Including estimate bf hours per week In paid employment.) 



a. If you are. currently enrolled in ah educational Inscltutloii for degree credit: 



What is your major field? 



If receiving a stipehd, what is the arooant? $_ 
'^*What degree are you working towar<^? - — 



per 
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• if currently einplbyea~(w^^ ; 

. ■ iniatMs ybiir ^p^^ brief descriptibh) 

.1 ^jaae of: brgarilzatibh, "sellf," stc.y _ 



YbUr current salary i^^^ d^diictionsi etb. (Esti^tes bUay.) $ -a" per. 

if Buperviso^ position, how many persons do you sapervise? ■ - •• ' - ^- 



What ire ybur ex^^^ remaining in this position." barring unforeseen developments? 

••' •' • ' 1, : Permanent, for the foreseeable future ; - - - 

- - 2. . Uncertain; depends on what alternatives become available 

^ Temporary or short-term * ; 



i ; lii:^ addition to these and other items concerning, career 

patterns, this survey includes questions to elicit a retrospective and , ^ : 
•subjective evaluation of. the educational experiences involved in the 
program. For exampie: • , , • , ;: 

• in ter^s of your own p.of..slonal growth, please indicate >.> scale of 1 to 5. the value of the , 

following aspects of yoii^ baccalaureate program in _ 

Ofiittle dfSdme Very • 

" ornSS^ value. : mliS^ 



Course work (Including labs, etc.) 
Clinical experience ^ 1! 

dther„"field work" (outside of class) 
Association with specif ic faculty members 
"interSU^ with other nursing students 



rkf so bacR .nd circl e tK. .he=K for the Ite^ you f.el ^ valuable for you. ^ 

If you had ±i to do over ag^l". i^d knowing what you know Sow about; the jbgtas. would you still 
enroll ifthe program fro= which you earned your bSccalaureate In nursing? 

1. "^ Definitely yes . . 

— 2.' Probably yep > \ * , 

• " 3. Don't, know ' * . 

. A. Probably no , . ^ " ^ ' \ . 

5. Definitely hb ■ ' • \ 



pinally/we assess once more each respondent 's interest , 
and ievii^of professional activities related to 

nursing. Studetits from whom we hav^ (Class 4) 

Will:thus have responded three points in tinier as entrants, 

as graduating seniors and as aluinhi. From these data we are able to ; ,^ 
measure change in this itnpdrtant area. ^ 

' Supervisor Rating Scale . . 

'. Along with the Pbst-Graduat^^ 
a simple form requesting the narae'and address of their iimnediate supeirvisor 
-.arid^liissidn to contact the person riam^d. When that information and per- 
inissi5S*is-' i^eturned^ we, send but a short ; (one-page) Superyisbr.,Rating Scale. 



, . As raentlbned iearil^^^ instrument includes a few . 

queries about the respondents themselves.. The central iterar l^owever , is 
the fbiibwings^^ ^.^ . . . . * . 

• How would you rate . this Waye. wt -epect ' to.the^follow^^^ "u'^r^ 

bther baccalaureate nurseB you knc^ and/or supervise? (Check one In ^^^^^^"f ^f.f".^^^^ ^""^ 
Jou simply have ho basis foi making 8 judgment concerning a.particular characteristic listed, 
olease check the '•unknown" column and leave that rating blank.? 

: Very Beldw ___ Above Very 

.\ ' : Unknown Average Average 

a. Conroitment to nursing . . . • • • • • • • — — — r— ^ . — — — T - [ , 

bi General intelligence • • • • • • • ' — — — — ~~ 

c. . Ability to perform assigned tasks . — — - • — — - ■ 

d. Motivation, Initiative ...... . - . • _ — z^^:^::^ ; — — - 

e. .Sound judgment; 



f. Makes workable suggestions for change 

g. Cbmrnuhlcatlon skills 

h. Problem-solving ability ....... 

1. Self-esteem/ self-^cbnfldence . ; . 

j'. Responsibility . ..... • • • • 

k. Sehsitivl^ty, concern for others ... 

1. Leadership skills .... • 

m. Potential for advancement .> 



With, the Supervisor Rj^tinf Scalfe, we cbiriplet^ : ■ . ; 

crlption of data-collection tools constructed to obtain information from j' 
and about the students theSselvis;^'^^^^ reihaitiing itistruinents toV ■ 

be described are focused* somewhat more brbadly to .provide a better under- , 
standing of the programs as whble^ fuiict^^^ unitSf • ^ ^ 

• - . j . Faculty Questionnaire - • ' ^ ^ 

• . This four-page survey consists primarily of ppen-ehded 

questions.; It begins with a few biographical questions concerning the 
Respondent's own pro^ and development j and go e^: on to 

ask about specific courses taught, about thg tone-of faculty interaction . ... 
in the department^ the overall experience of teaching in a ^ ^ 

second step, program. For example; . * . 

i if voii havi tSu^^^ coipare th^t, experience with teaching here. J^^re ther|^^y_^^ 

rLtflctf ons in^^^ .cractores, or increased options? Does program philosophy 

help br hinder yoa? If you team teach/ what effect does that have-on .you7) 

The final page contains a pre-coded item which deserves 



" special mentidri. Adapted tihm a f 5^ced-cholce question which was developed 
in the eariy. sixties tb assess student perceptions of thi nuSsirig prbfes- 

- sibh (OU^eri and Whittaker^ 1968, pp; 126-129) ^ thi^ item appears in three 
separate NSSf^ instruments: : the Entry. Questibnhair^^ the Graduation Survey 
and here in the Faculty Questionnaire. The data generated will thus permit 

"a^rTutSit of interesting comparisons, not only ambrig the Various faculty \ 
samples,, but also of faculty response^ those of students. :The item 
itself appears oil the following page. 

kv 'Faculty Interview Guide ^ , ^ 

this instrument guides the NSSP site visitor in conduct- 
idividual semi-structured interviews with a number of faculty members . 



on ^^clTcatiusT^T^^ greater- 
length, and to reorder questions to encourage smoothness of communication, 
tape recbrditlgs provide a verbatim transcript of the entire disc.ussion. 
the interview is designed tb take a little less than ah hoGr, although 
that may vary in either direction depending upon the the 
"style" of .the, individual respbrideht. 

"Nini topics are cbvered during these interviews: 

1) Distinctions perceived (if any) between second step graduates, arid 

graduates bf generic programs 

2) The place of; "liberal arts" in nursing educ^tibri ^ 

3) The role bf sbclal stiences in the curriculum 

4) Student/faculty iirteraction" • 

5) : Teaching' style* apprbach and/or philosophy . : - 

6) ^ Faculty interaction within the nursing department 

7) eiinlcal facilities* arid how related to educational program 

8) Effect bf the .location and surroundings upon the prb gram ^ 

9) Respondent's own philbsbphy bf riUrsirig , ' 

1. . Administratpr Interview Guide ♦ 

Because the programs participating in the NSSP were among 
the first to iipietnent a second step curriculum, the leaders of these six 
programs can speak frbra considerable experience about the initiatibri and 
development of such* programs . They have beeri able tb observe the effects 
. of their behavior arid <Jecisibris with* respect to program development arid 
the achievement of accreditation i ;This interview guide is. designed not ^ ^ 




Bil^ ar^ ilated certain characterlatlcB "which different people attribute tb huralhg. We want^ 
jrbu to consider each" characteristic from two vantage polnta: 

if rhe characteristic corresponds^ With your own picture of nuralng as it existrlatprc.senti P^^c^^ 
fcSck'^^^^^^ the left-hand sld._of_the: page.-DO mSjlEGARDLESS 0^^^ 

PESoStW APOT DISAPPROVE OF THIS CHARACTERISTIC, JUST AS LONG AS IT_SOtIEHOW FITS YOUR 
PICTURE OF NURSI^^P.; Do this left-hand colunm first. (Check as many aa ajjply.) 

If the charac£i*-isEic IB one yojj would llke.to^aie as Important In the future of nar8lns*_plac|^ 
rcSeck marrL'tHe column on^he right-hand side of the page. PO.THIS REGARDLESS OF WHETHER OR 
SofYoE TOINK TI:E CHARACTERISTia IS_CyR|^TLY PA^^ NURSING, JUST AS tONC AS YOU WOULD LIKE TO 
SEE IT AS AN IMPORTANT PART OF NURSING IN THE FUTURE. Do this column second . (Check as many as 
apply-) . : 



Characteristic Corresponds 
With My Picture of Nursing 
as It Exists Now . ■ ' 



Character IsEics 



Characteristic I Would 
Like to. see ^s Important 
in the Future of N ursing 



Order and routine •••••• 

"Clear cut lines of authority' ; 

Originality and .creativity 

Dedicated service to humanity r 

Moving ritual .jsnd ceremony . . . • • • • • ' • • 

Hard work • 

clearly defined work tasks, each person 
responsible for his/her own specific job 
assignment .......... '** 

Close supervlslbh\ and direction ,.***.•. 

Exercise of Imagination and Insight . . . . . • 

Religious Inspiration, and calling 

Hgclculousness . ...... 

Job security . ; .... 

Human drama and excitement 

High technical skill . • i . . . i i • • • • • v 

Emotibhal cbhtrol arid restraint • i . . . • • • 

Frequent Innovation In the solution of problems 

An occupation highly respected in the community 

Solid intellectual content • • 

Demonstrating care and .concern fbr^bthers lii 
an Immediate and tangible way • . . . • . . . • 

: Other characteristics in your picture of 
liursing br bf Importance, lii the future of 
nursing ^ • 




only to elicit "facts" -about how prbgrains dealt with the goal of gaining 
NLN accredit atibnV drawiri the leader* s practical experience in get- 

ting her prograiovfer that hurdle^ but also to generate insights which 
will help to aifine each adraihistratbr's leadership style.,. 

: Previous research has identified eight major areas of 

responsibility considered rabst iinpdrtant among baccalaureate nursing' 
prbgrain kyMnistrators (Stanton,^^ 1^ Zehr, 1975). These areas cdnsti- 
tute topics . for the interview: " - 

1) Budget . ^ \ ' . ' 

2) eoiDinuhlty service and relationships. 

3) Curriculutn and instruction — -i:^-: : — — 

4) Faculty 

5) Inst itutibrial' policy making ^ - - 

6) Professional responsibility: ' 

7) . Research ' 

8) Student affairs 

The major fbcus of the interview is tb -determine which ' * 
if any bf th^se-areas pdsecJ a potential, problem in achievement br 
non-achievement of NLN accredit at ioriv why it was prbbleraatic and how it . . 
was dealt with. Because; the achievement of Accreditation is generally ' ^l ^ 
ackn'bwledged to be of central Importance in the'^ develbpraent of any academic^ 
enterprise, such a discu^sibn contributes significantly to our uncierstanding 
bf each program's history as well as providing irapbrtarit ipfbrraatidn con- 
iceriiing leader /follower relatibnships. • 

'.*■„.-,-« . * ...... - ' ■ ^ ' ' , 

3, Observations document review 

.In a single-campus study, where the researcher is either 
employed on the campus or at least has frequent . and easy cbntact with \ 
students and faculty in thlir rfatUral habitat, direct observation provides 
a large part of the real information s/he has available for ana 1> is — raore^ 
in most cases, than the researcher is consciously aware of. Understanding 
a pro gram by being a part bf it or by having cldse cdntact with-it estab- * 
lishes^an unconscious^ knowledge base that gives rise to a host of* as'surap-^ 
tions about th'e tru&s.nature bf the prbgram--its curricular structure, 
methods of operation, and prevailing attitudes and values—many of which 



teSd to go unexamined by the '^nsldef;" An 5atiiae observer often perceives 
elements _ that .wduld_go,^.unSo^^^ x.-tto live and work within the set- 

tings simply because of their utter fam^ . - 

At the other extreme, the research design which depends- 
entirely upon data from tests, questionnaires and interviews fondue ted by 
"field wbrkets"— i.e., where the Researcher has drily "indirect", knowledge 
of the.settirig as inferred from written "or published sources—can also; lead 
to a. distorted view of reality. What may be a very obvious iriterpre_tat.ion - 
of certain findings to the insider. may never occur to the outsider. 

Because the subjects of otar six-campus study ^Mre so geo- 
graphically scattered, the use of direct observation as a means of data 
collection is. severel^ limited. Annual site visits of two days' duration 
on each campus, provide the sum total of our oppbrturiities for experiencing 
each o| the settings. How to maximize and supplement the informative value 
of those brief Visits in terms of data-gathering is therefore an important 
Wpeet^ of the NSSP methodo logy. • 

V Fitst, what is it import to observe? Actual behaviors ; 
obseryed. in classrooms , corridors arid clinical sites are of :■ obvious impbr- . 
tariceV\as are nbtes taken during interviews and^grbup discus^ibns. Among 
the subjects one w5uld hope to. uriderstarid more clearly by direct observa- - 
tion are:\persbrial irite'ractions, the actual classroom" conterit bf cbursds, 
teaching, styles and coiranonicative proficiericy, the general "feel" of a 
program's philosophy trarislated into concrete acts, and the institutibnal^ 
erivirbrimental and attitudiri.al context in which the program exists. 

Secirid, given thib 
: ckn you supplement \he valrie of your own experience? That 'is, what can 
; you take back tb! ybiiryJesk for qyaiitatSve analysis l)isidi^ ybur notes and 
i your impressions of what you have seen A flippant answer might 

^"be "anyt:hirig that's ribtN:ied dow^^^ the moRe dignified teriii we^ use to 
.describe all these "ot:her"\ sources of irifbrinatibn is "documents.", 

. ■ ■ ' ■- ' ■ ' ■ - ■ * ' - - • — 

- Researchers can work with documents in at least two ways: . 

'they can extract certain factual data, and they can infer or. speculate as 
■ to what the documerit writers th\nk about the 'tacts. The kirids bf facts . 
one can derive from nursing program dbcumerits include requirements for 
enteiririg the- program, cbsts of a^ the number and kinds^bf classes 



students must take', inside and outside of the departineht * the • individual- 
ized options available, etc. What writers of such ddcuraents think about 
their department ^rid its curriculum is quite another matter. We usually 
;cali this the program "philosophy." : - 

Whep, 1-eviewing documents (catalogues, brochures^ ' accredita- 
tion statemente, etc.), one must ;keep in mind that while information on 
departmental requirements arid offerings is usually given in a iairly 
straightforward manner, prograS philosophy is more subtle. Thdsii vho 
contribute to or author the dbcuraerits choose to include some statements, 
phrased in certain ways, and to exclude others. When researchers' find 
patterns in the carefully formulated stateraerits by .which people choose to^ 



ctraf^TeHzi"^?^ for public presentationr such patterns assume unusual 
iraportance' as empirical evidence. concerning that program. 

e. The Detailed Timetable ' ^ 

' ^Chapter II discussed the necessity for setting up an overall 
timetable with reasbriable checkiJdints to allow' for the entire project to 
prdceed at a /reasonable pace throughout the entire furiding period. Detailed 
timetables, including a listirig of the various tasks necessary to complete 
iritermediate goals*' can be helpful in several ways. They encourage you to 
think- through the various steps necessary to meet each goal, to arrange 
these tasks\ iri a logical ^sequence, and to assign theia to the appropriate 
staff member well in advance of the due date. 

The overall timetable provides the due date for ihajcr events, 
in scheduling the intermediate tasks, it is a "good idea to work backward /y 
frbm that date, deciding approximately hbw^lohg edch step shd:uld tak^^^^^^ 
then setting a feasdnaSIe^^^^ to accomplish it. For written reports, it 
is well to remember ta' include such things as typing arid probfreadirig as 
all of these things take time and mu^t be cbrapleted tefore the final dead- 
line. ^' ■ • ' ' ■ 

D. The Research Team : ' the staff arid the budget ' 

Having gone into considerable ;detail abbut what we plan to accom- 
plish and how, it seems apprbpriate to devote a few paragraphs to ^ topic 
rarely mentioned in routine ^research manuals: 'namely ^ who is going to do 
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the work. ... 

in the. real, world of graht-furided research, it is fairly typical 
for the research team to be at least semi-defined at the time the proposal 
is" submitted. T*e design itself, then, reflects what you assume to be the 
interests, general areas of cbinpetence and specific capabilities of those 
who expect to be pa the payroii. Not only does this allow you to draw iip 
a contract with some assurance of being able to fulfill it; but it also 
saves virtually weeks : (or pionthsl) of bureaucratic footwork entailed in 
recruitment procedures. The net effect of this circumstance is that staff- 
ing and budgeting are^ in a sense, "an- integral part of the methodology^ 

with each part of jhe^egga^ 

_ , . ■ - ^ . J' ' ^ - — __ - - 

To implement the NSSP methodology, a variety of skills and know- 
ledge are necessary, some of~v»hich are more obvious than others. The role 
of the Evaluation Associate, for .example, is crucial—someone to represent 
bur research interests on each of the six campuses ^ to alert us to impend- . 
ing "problems before they become crises, and to manage the mundane but 
/crucialiy important aspects' of actual data collection. Without such 
on-site assistance, we would be obliged to curtail data collection drasti- 
cally, limiting ourselves to one class of students arid a small sample of 
the faculty from each program. This assistance was made possible through 
an equitable exchange of services. Thus,' the participating academic units 
garner ■ certain desirablfs benefits from participating -in the project: a 
comprehensive' program evaluation^ kcCesS to a broad spectrum of data about 
their own program for internal use ^d free consultation as well as enhanced 
national visibility via project publications and conferences. , In return, 
th^ Departirieht Head on each campus selects a faculty memter whose interests 
and abilities match the needs of the Project, and provides that person with 
enough releaie time from normal acadimic duties (to equal approximately 

■ 

25% FTE) to se,rve as the NSSP Evaluat ion Asso^ciate. 

.. . .;■ . - ; . X-; , ., ' : , ' _ . ' '■ -• _ _ ■ ■ 

' : Equailys, obvious is the need for Central, staff whose expertise 

assures us of the accurate and efficient management andahalysis of all 

quantitative data. Since many data-collection tools- are specif^ to the 

NSSP (as distinguished from published instruments), data mariagemeht begins 

riot With the processing of returned materials^ but with designing the data- 

coliectidri schedule arid firializirig the instruments themselves for optimal ^ 

effectiveness. Similarly, it extends well beybrid prbgrammlrigcomput 



analysis and obtaining print-outs, through to interpreting and presenting 
thedatki ihaihtaihihg dbcumentatibn/. setting up an efficient data-retrieval - 
system, forecasting budgetary needs for quantitative ahali^siSi and writing 
up .the'*details of the quantitative vinethbdbibgy for project reports* Gon- 
sidering the cbmplexity of the quantitative data sets to be accumulated , _ 
sixty h^Sts per week are earmarked tb'handle these tasks? a f qll-time ^ * 

Data Analyst arid a half-time Student Assistant. 
. . . ' ' ■ V ' " . • 

* . . Next, consider those aspects of tHe NSSP methodology which depend 
entity upbri the demanding and !tiine-consuming techn iques of qu alitative 
analyses— interviews, direct observation,\ open-coding bf qualitative data . 
-from::Surveys,-JLriterpxetati^ bf dbcumehts and artifacts, etc. Although 
such dali fbrra a very small proportion of the total data set^ the very 
nature of the overall research objectives (see page 16) points up the 
importance of this analytic approach to their ultimate achievement. Quali- 
tative research strategies derive basically firbm the sbcial sciences, it 
is no coincidence, therefore ^ that the discipline of sociology is w^ll- 
represented in the academic backgrounds of those whb pbsed the objectives, 
designed th^ methodology, and cbmprise the research team. One ^ull-time 
pbsitibri is built around this area of-Gorapetence; the tlt^e of Project 
Jducator indicates that in addition tb being accountable f or ''all_qualita^ 
tive analysis, this member works closely with the Evaluation Associates iTi 
the further development of their research competence. ^ * - 

■ L .. . _ . ■ - - - - - ' 

• / The use of qualitative strategies ^Iso has .another impact upon 
the research team and, -it follows, upon the budget. Not; only^do the 
analyses themselves require more time than statistical manipulations bf 
quantitative data, but they ofteri represent a large investment in terms 
bf secretarial time^ particularly in the transcription ot literally reams 
bf tape'd inj^erviews, ciassrooip^bbservations, field ribtes^ etc. Adding * 
these taskfe to the already complex one of managing the research headquarters, 
vbluMnbUs cdrrespDndence amongst our "branch offices arid cbpj.rig with the 
•stresses-of putti^ oiit the ambitibUs number of reports and publications 
which' are planned, we prudently budgeted another, sixty hours^ a week tb 
-handle that work load: a full-time Admiriistrative Assistant and a half- 
time Typist.- . , ■ ' 

The^^ least obvious ^ arid at the same time perhaps the. most indis- 
perisibie rbl6\e.be played in the implementation of this particular research 



design is that wKich may be referred to as c5c3^dinat±dhi administration, 
ieadership and/or manageSiSt—bf ihgihg r.li the working parts together, . 
keeping them moving bh schedule toward the accotnplishmeht of the- broad . 
aims of the project, being accStmtible for the synthesis' of the .various 
research strategies as well as the prbdt'Ctiqn oflschoiarly reportage^ and' ; 
ictirig--ab"effectivi liaison between the NSSP, thi nursing profession broadly 
defined, and the ■fading agency. Two^^C are cirved from 

the budget "to serve these functions. One (half-time), representing aif iii-, 
depth and. experienced-baied- knowledge' of the nursing profession and its <key 
personnel as well as a track record of successful .grant administration, 
oversees the budget.- and maintains Ibng- range planning in accordance with 
the salient concerns of .the nursing prdfession and; of the\funding agency.^ 
Th^ other (fuil^time),: representing Research expertise in, higher education 
snk professional ^xpeiience in dealing with both quantitative aSd quali^- • 
ta£ive research strktegies, participates centrally In the actual conduct 
of the evaluation and is accountable , for both methbddlbgical decisidn- 
maicing and quality contrbl in the overall outcomes of the research process. 

Our human and financial recburces, then, provide a .total of ?20 
work-houfs/week;by central staff and another- 60 hours/week by Evaluation - 
Assbciates. Since our project as a _whole entails the accomplishment , of 
three non-research objectives (see pages 16-17) ,. some of these. ;r^sources are 
'diverted to work not directly irelated to the evaluatibii study itself." A 
cdnservati've estima'te of* research needs alone, however, would, amount to 
at iea^ The '^SSP inethodology is desighed arid implemented 

with those resourced assured'. Readers whb plari to adapt this design to 
their own purposes cari, of course, subtract many of those hburs for basic 
pi.yriirig, administration^ decreased d a tk. volume, etc. The bottom line, . 
howeveri must: pay f br. the skills and expertise which the "adapted" metho- 
dolbiy will ultimtely require. 
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r:' ' • ■ . ■ .'^ V ■ Notes V- " ' 

i; Table 6 of the CFI^andbook (eattell and Catteli^ 1959^^page 52) . , 

suggests simple linear age correction for^subject3 oyer the age 
of twenty-seyeh. Subset 

indicates that while scores do tend to decrease with^i^^^ 

age af tSr ^the early twenties also "to . 

level off; at. ab6ut:t^^ 

folldv^ihg age-corrc^tJ^n table, use^d in the ihterpr^tatidn of 

•- --NSSP -f es ults-;"-: 7r 'T. ■■; —■j-r—y • -''■^ -..-.-.^ _ - - 

' ■ . • ' ■ ■•, ■■*.. . AGE o / RAW SCORE PLUS ; 

. ^ 26 Qr less/ 0 / 

.. - ^ ••• . - 11 - . 3il. ■ : ■ 1 • I ■ . ■ 

: ' ' ' ^ <■ 32 ^ ■ .2" ■ ■ ' . ^'1 . ■ 

■ ' ,' - ^- < 43.-or' morje . ' ^ :. ; ^ ■, ' 

■ . '"-^ ^ ; / / . •:. ■ ' ■ ■; . ' ■ 

2. Readers who wish 'to obtain copies of .specific instruSents described 
in ; this inanuai,may/do sd/^ a small charge to cover the costs of 
duplicati(5n and maiiin may be addressed to:. 

_ '. - The 'Hatidjtial Second 3tep^^ . . ^ . • 

~ . - . ' ' c/o Dejkrtmerit of Nursing . 

- Sonoma State University ' • ; 

^ " Rohriert Park^ CA 94928 . ' \ 

3. Jji e^rly NSSP staff decisi^^ to dispense with th^^^ 
^ effort, to db>tain an accurate refiection^df "units- pireviousl^^ earned 

; (Form A) y siticg little, dr no consensus -existed as to what ah "eaxTied^ 
/ tinit" actuaiiy repres sidev howeverv the ^pro cess 

\ of coping witli probiems of interpretatidn, clarification and. definition^ 
. inherent in the- c6mple$ibri of these forms, can provide unanticipated. 

and usefui insights/.;^ ^'Withdrawal,^ for ih^t_a^^^ tends to be an ^ 
V ambiguous and iii-defined concept which. may be an- 

overall enrdll\nent j^ of ways. How a student goesr 

through ichdoKs) tn^ reflet that individual's own chartcteristic 
^ ■ approach to fbfinal| e^^ academic :propram^ defines and 

deals with nbn-cohtinubus ehrdl^merit. patterns may, in^tum, reflect ' 
its bwn philosofe^^^ of -educatibh aiid Achievement.; Being alert to the , 
conceptual potenti|al of .the data you collect , _eyen from such a seem- . 
ingly cut-and-drldd . instrument as the EADS^ can contribute to the 
Ahaiytic quality Wf the' completed data set. 
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• ■ • CHAPTER- IV : 

' PROCEDURES:. Putting tfie Plan Into Action 

. . \ * So .far ^ we have dealt inainly with planning— admittedly a large 

: / ■ . part of the tesearcli process, but hardly the whole story- We have: deline- 
ated the background arid context for the evaluation, posed the objectives ^ 

* ' desigried a methoddldgy-i and specified by, whom and by \di at means the study 

is to Se' carried outv In .this chapter ^' w^^^^ from piannlng to action. 

7 A. Data C bllectidn 

■ ' .. ■ _•_ . : ■. •■ . •_■ _ - : -• 

' . * 1. ,T:he instrximerits a^^^^ by which raw data are gathered^ 

/; / ' according to the NSSP methodology, have been described in some detail. 

/ in the mind of thfi researcher ^ however, data collection ^begins prior to 

the actual "use" of those instruments arid techniques. Thinking about how 

they are to l>e used arid how their informational yield ^is to be dealt with 

isy itt that sense, an essential part .of the data .cbile^ 

■ - Sfe methods for definirig a^^ insuring an> adequate response rate: * The fbl- 

. . iowirig pages discuss some ways and means of accoinplishirig those tas ; ^ 

1. Fi iializing the pro^^ct ^-^esi^ned instruments ^. " v r ' . 

; ; _ ^ . Draft^s bf jmdstr d^tar collect tools were appended to :th_e 

pro ject propQski , pirbviding opr funding agency' with : a notibri}(c)f the types 
of instruments we: hact^n mind. Betweeri 4:hat time and tjieir actual use, ; 
however^ a riunier bf ;steps "were; riecissaryr-^^ arid\ sbme tech-, 

nical. .eriti^uing^,^^^^ early drafts of original research topis 

is necessary iri order tb Insure the ^ a database, and, to, 

facilitate data processing. Th^ f ollowirig/ suggess^ibns tiiay. prove helpful 
in approaching those: tasks. ^ 

■ Mr^ti make a vafi^le list . - It ■ shb^ evefything 
you really need to know, : regardl^^^^^ of whether such inf^ 
collected by means bf tests, questionnaires^ or interviewsV. Be ;specific. 
^Family background," fbr is probably tbb vague to i^ic^ a 

v^riabl^v Vhfere^^^^ may" :(pr m^y not) be of ^qgres 

if\^bu'h^^^ pfevioiis-research,; revie^J^; thbse findings fdr^ 

to'key varia^ may wish to consider adding to your^ list. 

iinpbrtkriti check th^ completed list '^gainst your research bbjectives ; .Be • 
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;sufe y5a^ iSfbrinatibhai heeds are covered; deleti va^ikbles that are ribt'^ 
reieVarit' Then, in- -reviewing the tiStative drafts of your data-collection 
instruments i questloh-the ihclusidh of items that appear extraneous to your 
heeds. • , ■ 

.Next,, consider the response categories of all pre-coded items. 
What "chbicei" are .available" to- the Respondent for ahswerihg a multiple- 
choice item? Do they exhaust the .pbssib-ilities for respondiftg, such that 
each person Will be able, to find an appropriate rfesponse? Are they mutually 
exclusive, such that each respondeht can easily select one single appropriate 
respohse? I.temg that have produced, clear, troubie-f fee data in previous 

research are useful ih this regard. :^ 

• - ■ ' " , • . . - , ''*.'•', 

• : " vAlong the same lines, consider the level of. measurement; _ 

This is e^ecially important iri pre-coded attitudinal items which usually 

include a scale from "low" to "high." Is the level t.f measurement appro- 

priate for the intended analytic teQhriiques? Since our quantitative analytic 

plans include some scaling and index construction, we settled Upon a 5-point 

scale- for most attitudinal items. ■ , • - 

With not one but several samples from each school, we have a' 
wide choice of potential respondents for each question we pose. Can the 
information bist be provid ed by ah entering , student , a s tudeht mid-way 
tlirough the program, a graduating senior, ah emplbyed graduate Or a faculty : 
member? Some: items are ^mbst apprbpriate. fbr bne particular saS^le, while 
others may be pbs^d.tb two or more san^les ih order to yield compirisons 
over time or among groups of respondents. * 

The distinctive advahtage of a longitudihal design is,,that it 
permits, in addition to cfoss-settibhal comparisons, measures of lhdividual_ 
change. This advantage cah be lost ^ .however, unless those items through 
which "change*! is. t5: be measured are ' btated such that the data they produce 
Will be truly cbmparable. - To assure comparability requires careful • atten- 
tion to both the wordihg ahd the timing of the data-collection tools; 
Readers who plah tb adapt the NSSP design to their own research piurpbses 
shouid be aiert to sbme' of the common problems related to the measurement 
of chahge in cohort ahaiysis (Glenn, 1977, pp. 27-41). For example: 

--Aire the respondents "themselves truly cbmparable? (For Instancei is an ^ 

answer requested of : "ail s^^^^^ an^ "women only" at another?) 
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—Are the.. Sesporis^ Categories ideritica^^^^ -^^°''^"^Fm^^' 

of a scale labled as "important" at one point and "crucial' at another?) 

--Is the response subject to shbrt-terin fluctuation? (For instance ^ hours, 
.devoted to "studying" may vary widely depending on how close to final 
exams the questionnaire is administered.) ' _ 



—Were influential but "external" factors the same? (Does a salary increase,, 
for example, indicate real advancetnent or merely inflation?) . 

^ ; . Attending to all these details, drafts of the enttre^^^^^^^ : - 

articulated instruments are constructed and carefully reviewed for clarity, 
style arid flow as well as for relevance to specific research needs. Gutting 
and pasting, the final lay-outs 'are assembled, the data-processing codes 
added,.' and thi, completed; tools are readied for use. The first page of the 
Entry Questionnaire appears on the Mlowing page as an illustration of 

. style. and format. - . 

2. Sample lists ' 

From each. of the six participating programs, the NSSP collects^ 
data pertaining to five classes of students (see page 23) as well as frooi 
the faculty. "Listing" the' sample is rio simple task. We compiie iix lists 
of faculty arid thirty lists of students or ex-students (graduates) . Know- 

ing wild comprises each sample is essential. 

■ ■ ■ r:::, ^ _ , . \ ■ , • _ _ . .j., _____ 

The faculty sample is quite simple and inclusive* All faculty 

and-adudniltrators who '^teach and/or advise Students, as the study begins, are ^ 
included in the sample.; E^h ^s; giVeH ^ three-digit identification number ,. 
_the first ideritifies the school and the latter two are; sequeritial numbering - 

of all faculty within that program. Student samples are considerably more 

complex. . ... , .V 

Each Evaluation Associate lists by date of ^ntry every studentV 

from whom we expect, to collect data. In order to do that, however iwe.must 
first answer an impbrtarit questiori: What constitutes entry? In -a- two-plus- 
two prbgraffi, there may be no clear begirining poirit, sirice mariy students simply 
continue f^qm lower to- upper divisibn. Thus , som^ take supporting courses • 
before beginning their nursing coursework .while bthers take these later. To 
add to the confusion, schools bf ten admit studints k two or three times 
during an academic year; It becomes necessary* thert^^tb specify precise 
criteria enibling each. student to •be' "assigrie^ k c^ass, and to apply 
these ' criteria bri a case-by-case basis. \ : 

: •■ ' ' ■ •. % ■: ^' . ' ■ '" . ■ ■ 
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Tbiir name; 



NATibiiAi SECdin) sTEt> project, r 



(to be resibved when XD\# tB assigned} 

V- I D # ' ______ 



(Leave blank) 



ENTRY :QUESTI0NKA1RE 



1. 



Wiat was tke highest levei of 'education attained by your. parents? 

Father Mbther \ ' : 

■■ i* Sonfe high school ^ (or less) 

2 , High schobl graduate , . / ^ _ 

— — • ■■ ■ ■ 3; Vocational or business training other than two-year college 

' — 4. Some college, but no degree^ , 

5. Graduate of a two-yoar cpllege, 

' — 6. Graduate of ^a fout-year college : 

7. ' post-graduate study but hb degree 

^ . ■ 8. Master's degree. _ _ 

^ . . 9. Doctoral or professlphal degree beyond t^he Master s level 



■ : 1-5, 
6-2 

* 9-cbhserit 

: r 



10 

11 



2. 



3. 



4. 



7i 



Please Indicate vbur parents^ uSual occupations during the time you'^were 4n high school. 
Father.r • ' " • • - ■ '. . , ' " ' — — : — ' — — ' T ' 



Mother 



Approxlaiate combined yearly income of your parents (at present) 



i. Under. $5^000 

2.. $5,001 -'$10,000 

3.' $10^001 - $15,000 
$15,001 - $20,000 

5. $20^001 r $25,000 

6. $2^,001 - $30,000 

7. Over $30,000 \ - - 

8. Have no; idea ^ .^j^'^S^ 

9. Nbt applicable (both deei as edT>s^J 

in what religibh have you been Taiepc? 




1. 


Catholic 


2. 


Jewish 


3. 


Frbtestant 


4. 


Other 


5. 


None 



.5: Vhat £8 your furrent marital status? 



.1. Single 

_ "2. Harried 

3. Uivorcisd or separated- 
Widbved 



6. Number, of chlidr.in7 



(What ^ re their ages? 



a. • Please, go back^nd circle the ages b£ thc^e that are living vliih you. ^ 
With whom db you shire you;r current living sltuati&n? (check all thit arply) 

No one (1 live alone) ' " 

Spoused or mate 

My_chlldreh _ _^ 

' Parents, in-laws and/or o«?et rs-^'^tives 

•r-rirr Adult (s), not related me by kinship—wi^h br vlthbut children 



If things work out the way you t.jant. wheii HOuld_ybu U;.c to get married? 

!lf: currently married, check here- and g^: on to the next question.) 

. - 1, Wlnhiii the next ehree year^ 

. ■ ■" ■ ""2.V. ,'5 \^ 3 _years_frbm_now.; ■ -- " 

* ■■ 3, ' 6 /csrs or more f rota now / 

~7 4. i don't v^iit to get married 



12-13 

iA-15.. 



21 
22 
23 
2,4' 
25 



26 



6 



When "term of entry',' is .deteririihed for all (Students, identt- 
ficatioS SoSbeK are assigned consisting of, five dlgiti;. The first denotes 
the schbbii the second 'the clas.s (by academic yearj * arid the third the term 
of entry. The fourth and fifth digits provide a sequential numbering of 
students in that school, class and term of entry. This functions similarly 
to a postal zip code. • ; ; ':: 

Sirice bur data-gathering plan is based upon the respondent's 
status in the program (i.e., entrant, erid-of-first-year, graduate, faculty, 
etc.) , each phase of the data, coilection requires a list of persons to 
whom certain instruments a^e administered. Forms were cteated in order. to 
maintiin records of wha,t data shbuld bk acquired for each individual, as • 
well as to recfbrd when such data are deceived. One form records each 
student's status at' the end of each term: enrolled and completed, withdrew 
: aid not enroll, graduated, etc. This is used tb defirie a "target sample" _ 
for each instrument at the various data-^nbll^ction points. Others- list: 
each target sample (both student and faculty) and have boxes to be checked 
wheri each iristrument is received. 

St Obtaining cbrisjerit and Iftgurlng confidentiality - ' 

- To, comply with Rights bf. Human Subjects regulations, every 
Respondent must cbris^rit iri writing to. participate , in the research effort, 

; grid procedures t'o insure .the conf identialfty of the data tliey: provide ^Ust 
bi iiSictly observed. Ori the riext page is in example bf our studerit ,cOri- 
sent form;' Forms. sent to other respondent faculty and post- 

graduate simples , differ 'slightly in wording and; detail,: depending .Upon ^ 
the recipierits arid the extent of their expected participatibn. In all ,^ 
cases, howevir,;,. voluntary conserit mUst.be obtained and kept on file throUgh 
out . thfe conduct of the research. . - . , . 

• " "Respondents' ID numbers are coded directly onto all tests, 
qUestibririaires arid interviews, after which names are removed from research^ 
instruments/ Matchipg lists of riames arid ID's are kept only in the. central 
project office. Thus; magnetic tapes br copies of the IBM cards can be 

'made available to the Evaluation Assbciates should they wish to perform 
additional iriilys^s of t^^^^ data, while maintainirig corif ideritiality. 

' •; • • ; \ Oiir prbpbtar^ s that no infbrmatiori that could be traced 

to iridiyiduais may be released to hbri-project staff. If participating 



ID # - 



CONSENT f 0 PAfiTieiPATE IN RESEARCH 



As psrt of a longftudinal and comparative research study, conducted^ 
by the Natldnai Second Step Project and (name of institution) Depart- 
ment of Nursing, I agree tb complete the limit edinUmber of ques.tion- 
naires-aridltests requested from time to time.* I Understand that the. ■ 
data contributed by ine Wrb^^^^^ and that all finding? 

froi the study "will be presented in such a manner as to. insure complete 
"confidefitiality. 1 understand that my participation is ^voluntary. 



Print Name; 



Permarieht 
.Address: 




City 



State 



Zip 



*If you have already graduated-^ the ericiosed survey will be 
- the- only pneTyou will be asked to complete. 




prbgrams desire access tb certain, b£ the NSSP data for: other ireiea^ch, they 
tjiust obtain additional consent from their own stadent samples for these : 
bther purposes. Iridividuii respondents, of course, may send a written ^ 
request and receive certair^ findings pertaining only to themselves , such 
as a personality profile, since tto breach of confidence occurs in that 
instance. • '. 



4. Distribution and- jolj 

The fitst step in distribution is handled by the central - . 
staff. All sel£-administered. instruments, consent forms, instructions, 
and cove?:-letters whichl.pertain to. a pairtlcular sample at a particular 
.point in time (e.i., .''entering students. Fall 1973"^ are assembled and an 
■individual packet is made" Up f Or each respondent. These. pac:kets contain- 
everything the respondents need to know in order to understand and partic- 
ipateuin; the research effort, including a brief but convincing appeal for . 
their cooperation. The idea is to make it as easy as possible for. the ^ 
person. receiving each packet to .respond to your request; a postage-free . _ 
self-addressed envelope; for .the return of all materials is a must. 

' Take a positive approach. Make. the assumption. that each 
person who receives a packet 'wilt respond fully; do not offer alternative . " 
procedures for not responding, such as suggesting that blank questionnaires ^ 
or unopeSed packets can be returned to the departmental office .. It 's true 
>that^participation is voluntary, but requesting: the return of blank mater- 
ials' at ; phe time of ihi.tiai distribution i4 self-defeating. That step- is 
taken (if at ail) only after. all possibilities for achieving ^ a 100% rate 
of return have beefi. exhausted^ This is especially importint in "a iongi- 
tudinal. research design, where samiile atti-ition can threaten all subsequent 
analyses.? Once thk packets are "Assembled; they are put. together in bat ches^^ 
by target' sample (te.g,, "entering students," "returning students, '' ^faculty,", 
itc.-) and bvindied for distribution to the six campuses. ■ 

Response rates tend to be| higher when data are collected b^. 
pebple 'clos^ to and known by the ^esporlients rather" than by a distant 
arid impersonal agency such as "The Nat 5?bnal Second Step Project." Therefore, 
the Evaluation Associate on each caSpus distributes; and collects ail pencil- 
and-paper instruments. This involves setting up testing sessions for the 
timid-idministrations required for NLN Achievement Tests.arid the CFi; . 
arrarigirig for the "personal" distributibri of packets to on-campus 



responderiti iccbinpanied when possible a "pip^talk" to ehc.burage their 
pairtiapatibrij. and mailing- out P5it-eMaUatibh S^^^ recent griduates 

--Which of ten, iians' ascertaining. cu^ addresses beforehand. "Central' 
staff meinbers conduct the interviews, but: the Evaluation Associate does 
the advance work and' iets up -appointment' schedules. ■ - 

" .V One topii. not often ^diScusse'd in research bobks is. cbmpbsirig 
^Vei .litters for questibpnaires' adiinistered by-mail. - Ther a 
j&itlbniHg, and should'be written with" at least three basic assumptions ' j 
is\mind. 1), Your respondent s are probably not eager to fill but your- 
siytey.form. Give them ^ co^viScing Treas^^^^^^ so. 2) ^They may 

not even want to, read your letter. . Keep it as" short and interesting as, • 
possible. 3) Their decision as to what to; dd about it will pr^^^ ^ 
made within/f ive Sinutes bf opening the envelope. -A "due date" far in. 
the future will encburage" them to put it on the back burner^and subseqt^ently 
to Ibse it. Ask for^an early return, specifying a date'when feasible. 
• ' The EVal'uation Associate maintains a list of who r^^^^ 

packets and conducts fpllbw-up activilies as ne'cessary tb retrieve . those . 
still but^standing as. of .the suggested due-date. The type of fbllow-up~ 
whether' "in person, "/by p.hbne.:br by mail--wiil dfepend upon 1) the number - 
of noh-respbhdents to be contacted and 2) ..their gcceasibility.^ Tact, , - • 
diplomacy and persuasiveness are often required, but also the "quick recog- :/ 
nition of an adamant non-respondent in time to avoid unnecessary antagonism;-^ ^ 
Again, ■ the b^t approach Is a pb^itive bne, stressing the potential infiuence 
qf each lndividu^'i the futuie and directions; of their programs - ' 

sith students and f aciilty 'need tb ^understand the importance of their responses 
and to feel that' their time and effort contributes to sbme wbrthwhile purpose. 

5. ' latep^ewlng j observing and cbllectiag 4ocuroents ° . ; r , 

These three data-collection techhiqvies differ in- two important 
respects f torn the survey methods emplbyed in the use of "questionriaires and 
standardized tests; .1) They produce data that is essentially subjective 
and qualitative in nature, even though quantifiable variables may emerge 
froi the subsequent analysis "br-such data; and 2). in the NSSP design all 
three take plac.e aimbst -simultaneously ,. within the constricted time period 
of two-day site visits to each campus. 

.: ;. These visits must, of course, be cobrdinated with the 
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; Evaluation Associates far enough in advance so that travel and lodging 
arrangements can be inade. Additional factors in this ijiaiining process 
include 1) avoiding holidays and pressure points, such as^exam week^ in 
tha acadeinic calendar so students are not too preoccupied with thoise matters 
to give us a: full and accurate view, of the program; 2) doingXseveral schools 
in a sweej) diie to time and. budgetary restrictions; 3) securin&^pemssion ^ 
to observe in' ciasiroom and clinical settings; and 4) selectingXstiident ^ 

and faculty interviewees and alternates. 

■ ' ' - _ _ ■ \^ ^• 

• As discussed in the previous chapter, semi-structure3 inter- 

views are scheduled with three set^ of respoSdents: faculty, administrators 
and students, the latter being ''interviewed" in a^^ group discussion format. 
Although the chief administrator of each program is easily identified^ \ con- 
siderable- thought andpianning goes Into the selection of which faculty and 
which students will ''represent" the bpiiiidnB and attitudes of these larger , 

samples. - • . ° ■ \- • 

. . To maximize the usefulness" of data gathered from. group dis- . 

cussions with § small number of students, we set certain criteria for 
i-ticlusion in .the potential' pool of cases .from which discussants„ are ' 

selected! First arid most obvious , ';they must be ;ctifrenyy_enroi-l-ed arid 

..present on the campus at the. time of site visitil'^' Second, they must have 
agreed to participate'iri'"the7SSSP' research, and have a sigried corisent form . 
on file. Third, only- those^ studerits with a relatively complete file of 
eritry-ievel data are included in the" population from which group discussants 
are. selected. Finally, we weight ' the iri^^^ in favor of our true 

Iqrigitudiriai sample, not by excluding earlier entrants but by stratifyirig 
the resulting population by class^ arid raridbTnly selectirig a majority of 
discussarits from, class 4. ,. . . ; . 

Faculty iriterviewees are chdseri somewhat differently, although 
siight variations of the f irBt" three criteria outlined above bbviously apply 
(being on campus during site visits ^ arid havirig both a signed consient form 
and other research materials on file). Total faculty samples^ however, 
are quite small in comparison with students. Furthermore, the range of 
their coritact with, kridwledge about. and actual involvement in the prograffi 
as -a whole can vary considerably, affecting their value as the "best" source 
6£ information . Orie may inerely " teach a single required course from another 
depWrtrnfent; another may. come in one evening a week to supervise a few , . 



studettts in; a finical setting; , while 'a third may h^e held a ^^^-^^ ' 
teicfiiSg apbbihtiheht.in the prdgram stnci Iti ihdeptidh arid chair the cor- 
ricuium coinmittee. Questionnaires cbmpleted by the total faculty sample . 
(see page 40) make these kirids of 'facts available, and permit a three-way 
grouping of the tbtal populatiSn ilong a, dimensibri bf participation/ • 
involvement; ,. • . \ 

Faculty intei^iewsi theri^, actually coS^ 
ience survey (S3lltiz» 1976, pages 94-§7) ; Only when the riumber of "high 
pIrticipatiOH" faculty members ^quals more than can be interviewed, during 
the brief site visits does raridoffi selection become necessary. It. is impor- 
tant: to' note that because of th^s method of sfelectibri, interview data can- . 
riptilegitimately be claimed to chafacterize the faculty as a whole. The. , x 
primaiy aim is'to' generate insights rather than statistical. descriptions. 
Quantitative findings .froS faciii;ty interview data are generalizable. only 
to the population of "high participation" second' step faculty. 

-; Ail interviews and discussions are ta^ed for late^^ranscrip- 
tion , ■ leaving, the ' interyiewer f ^ee ' to concentrate bri maintaining rappbrt ^ 
elicitirig pertinent information and "observing" (and noting foi: future 
.reference) .those affective cues 4hich often transmit as much information ■ 
as the actual words that jare sjioken., / ' : 

Two staff members are primarily responsible :f or , coliectin- 
qualitative .data from eSch site^; j Their tools consist 6f 1) interview^ 
guides, sample lists arid appointment schedules; 2) a nbtebbok and a small 
unobtrusive tape recprder;, -3) as much prior knowledge about the site as. 
they can absorb before^ settirig out; and 4)7 alert, naturally curious- 
knd open mirid. On' a. two-day f-itel visit, Everything seen or heard is poten-^ 
tial data; Bulletin board irifbrir^tion next . to- the Nursing Department of f ice 
cari tell ybu about things like the formality and cohesion qf events arid 
social life in the departmerit; faculty and . student dress cari be rioted; the 
hours of campus eating facilities "caS telt ybu wheri pebple'are on can^us, 

.arid so on., " • ■ ■ ■ _ ' \ . 

"' V ebseSvatibn, when used .as a research strategy, implies 

than looking and/liitening. The Sosf difficult part bf the technique, 
especially for the novice, is to write down ^at you see and hear~nbt just., 
what' you think about it. " The events themselves, in recorded form, comprise 
the raw data; the observer's impressions : of tho^e events are inferences 
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Which may be substantiated, ^refiitedi changed or elaborated upon as further 
data is acquired. . ' * 

Finally, the cbllectidn of "documents" completes .the NSSP' 
data-gathering . procedures. This term covers a broad range of printed 
matter— anything "that is considered informative iii terms of the research 
questions. Copied of departinental accreditation reports are probably the. 
most difficult to obtain^ of the various docuiTieilts one might select, but 
hahd'rbl^t sheets, program newsletters'^ and a variety of other materials are 
, usually readily available. " \ 

B. Data P rocessi ng s ' ' , • 

> in a lbng--terin research effort such as that represented by the 

NSSP, botli data collection and data processing take place more or less. 

continually from beginning to :end~br at least untir both ^ are completed, 

- ' . ^^tj^ ' ' -' - "--^ . - ■• 

which is usually a few months prior to the end of "the funding period.. 

Survey instruments are continually administered, interviews ^ are intermit-. 

tentXy conducted, and the resulting data are continuaKLy. processed for ' 

' further analytic use. ' . 

From preceding sectioni of this manual, the reader is 'well aware 
that our research design calls ifbr the ixtensive use |of both quali^tative 
an^ quahtitative'^trategies. Aithqugh the goal of both strategic^' is the 
accumulation and interpretation of informatibn that will guide the : ' : 
'^researcher in addressing the overall research objectives^^ processing, the - 
data that are acquired by means of these strategies differs in several 
ways ^ one f rbtn, the other. . : : . - , j 

; Many qualitative strategies hecessaVily .,im|)ly that the entire . 

research process i from the posing of a question through to the Interpreta- 
tidi^; of a "finding," proceeds In a hiply " integrated fashion. ]The_persons 
' conducting the research are a ided by interview guides and tap^J recorders, 
but they themselves create the indispensable link and the int^lectual - 
filter Between an external reality and an internal assessment /of the' . 
meaning of that reality. They decide, from one moment to -the/ next ^ hbw 
a question is to be phrased^ whether br not a response is ad^quate*i w^ich 
observatibns are tb be recorded in field notes, which documents are worthy 
of adding to their coiiecfcionsi arid how best to pursue and •Jtest out" a^ 
cdricept that has begun tb take shape. THirough conversations j individual 



iSterviewsi group discussidflSi obie^vitibns and the cbiiection of "evidence" 
in the form of documents, ideas are c(^'staritiy generated .and refined in the 
mind 6f the traiiied investigator. These' ■ideas influence riot drily the ulti- 
■ mate putcoLies of the reseatch—iii.", the Eventual descriptions and explan- 
ations of the phenomenon under examiriatlon— but .also the. constant selection 
' . of which- particular "d;ata'V ^re worthy of further exploration and analysis.; 
it is this flexibility arid fluidity-=the simultaneous nature of cdllectiTigi 
mentally "processing," interpreting^ and then.validating one's own perceptions 
. . wiih cbristant reference, to the pheriomerion bein'g explored—which characterizes 
the real strength 6f qualitative research, and which also distinguishes it 
most clearly from quantitative methods. 

Quantitative Strategies are necessarily segmented. The useful- 
ness of quantitative data in addressirig^ % overall questions pbSed is 
determined by the ingenuity of the researcfter at several separate arid time- 
specific 'points iri the research process: selecting' arid/or constructing ■ 
.the instruments themselves, setting up the data-collection design, irisuring . , 
. ■ an adequate. rate of ^return, accurately processing the raw data as they are 
received, employini appropriate arialytic techniques and taking care to^ 
observe the rules of iriterpretation which each arialysis implies. Once the 
^ research tools are. in the hands of the respondent, however, the iSvesti- 
" gator iff .totally removed frdni the research process until the raw data are 
available, for processing. ;,; ' 

.The fblldwfng pages treat the topic of data processing separately 
-•^ for infoL-matibn gathered by qualitative and by quarititatiye methods. Although' 
both- procedures .lead t6 the solutiorijof the research problem by the accumula- 
tlon and organization of relevant empirical data, the means by which this 
- is accomplished requires an awarenesd bri the part of the Researcher of the " 
'' potential strengths and .weaknesses of each strategy. ' / 

{; , 1. Quaiitative data ' , : ; ' 

. ' Since this is a handbbbk rather thiS ari introductbry text- 

t * 

book coveririg urispecified research content, this section on qualitative 
' data processing is arrariged accordirig to source.* Although we can be quite 
specific abbut how each type of information is/processed, the underlying 
principle is always the same^ ' tb retain the diversity. of the information " 
you have collected, seekirig unifying themes which make sense of it all 
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afid lead to' inferences, but without Idsihg the original flavo^ inS Sean^g. 

' Theie are four basic sources of qualitative data in the NSSP: 
open-ended items on questionnaires; iHdii^ group intiSViews; field; 

observations; and document reviews," In each ciii, the basic data-processing 
strategy is to 'approach the data with as few preconceptions as possible, to 
sumin^^e and classify whatever irifbrmation emerges then to review its 
pattims and linkages with other data for inalysis and interpretation. 



a. items from questibririaires „ 

^^^^^ : • E 

respondent «s . invited to write irt rather than simply to! "check", a response ^ 

Siich questions generally request a personal view of a broad topic, where , ^ 

pr#-cbded categories iay tend to restrict br distort the respondent's ; 
■^thinking, and vhfre the "flavor" and context of the answers are as! impor- 

taht as the factual content.. ,It is uskful to have ail such. responses frbm , 

a given instrument and for_a_ given respondent typed onto one page. Although / 
}this may seem like a trivial step^ its basic. i>urpuse is to increase both \^ 

the accessibility and the sheer legibility\o-f the data. Researchers can 

easily scan respbnses without flipping through stacks of thick questlon-c. 

rilires arid deci^^^ a variety of handwriting styles; And, since names 
: ate rei>laced with identification ntmibers , copies -of the transcripts can be 

^de available to Evaiuatibn Associates for use in program developierit ^ ./ 

without jeopardizing cbrifidentiality. 

r' When available for all persons responding to a single ■ 

. . instrument, such transcripts facilitate cross-sectional scanning. Each 
■ :resi)bndettfs .answi^ to a specific qUestibnnaire- item appears in roughly 
. thei siie Vplace" bii' each transcripts so Responses can be read through for 

patterris,- trendy, and divergences. The researcher looks alsb tor. under- 
. lying theines. which create the patterns- Such themes may serve" to charac- 
: terize iatgfe numbers of to discern.' unifying elements in tp^ie, ., 

contint and/or - iinplied: attitudes and- values^ -or . t^ tS ay s erve to distinguish " . 

several equaiiypreva^ °^ responses 

\, ;to- a ;singie^questibn. • ; ■ / ', ...... . ■ ' • ' 

' ; ; . • •; ' Sy -bringing tb^ether all the prose arid commentary that: • - 

-a^ siSgie Respondent has furnished in responding to a variety of-questions , • . 
.:^e. tikriibripts can of ten provide a„quick-bver .tew-of:--that_perso^t^z:i)viMll _ 



_, . ■. ; . .,■ . ; ■ _ _ _ . . . : 1 - 

attitudes and brieri tat ions' at the time the questionnaire is administered 
(for exaii5)le, "^t etitl-y") . Both the expressiveness arid the ''factual I cbritent 
of. the commentary as a v/hble may suggest global characterizations of, • \ 
respondents^ useful ih later analyses. ' / . 



For J students. in the- longitudinal sample (Glass 4), the / 
transcripts serve s/till another purpose. Ideally, at. the end of the data- 
collection period we have four pages of open-end responses and reievent / 



'cdirSiiT^^^^ at entry, at the end of 'Eheiff^ 

first year, as they are graduating and after they are in the field as bac- . 

calaureate nurses. ' Tpis constitutes a rich and concise body of qualitative 

data that can be reviewed for evidence of change arid development over/ time. 



b.,. Faculty interviews and student discussions 



Two 



forms of data emerge /frdm thesiB informants; /The \ 
primary brie is the verbatim transcription of t during the 

sessions. As vith the questionnaire transcripts ^ this facilitates read- 
ing through the same topic items on all of them. Although each separate 
transcript is lengthy! and detailed, the: riiimber of trariscripts frbra each 
campus is quite smallj Iri* cbraparisbri with/ those from questionnaires. Thus, 
responses can of ten b|e usefully sunSarized by topic^ and ribtc t^aken of 
recurring patterns and divergences from/ them. Sometimes it isjpossible 
tb summarize a "modal!" response, althbdgh co^f licting -statemen^ts are also, 
recorded. Responses jgiveti by faculty and student discussants /on each 
campus are th^js reduced in, form to abotjit one page for each topic. 

V The' secbridary form ok data consists of not^s made by the 

interviewer during or. ^ the sissiori. Strictiy speakings these 

-are field observations. Among the thinks the interviewer records . are ' . 
distractions' that mayj have hindered the Ithoughtfulness of the ariswers,^ 
mitigating interpersonal irifluiriciirii^^^^ ^^^^ ^^spond- 

erit is trying to m •5?;.. 1 good impression, or is shy, or reacts adversely to 

■. ■ _ ____Y _ _ -/-•: ' 

the iitterviewer; t- ^ dimension of validity is the extent 'tb which the ' 
informant was able to '^ive accurate and fp^thright answers. This is 
especially important during the student dis since beiiig„ in a 

group might m^ke r^spbndents bolder more feimid. It is useful to have 
one researcher conduct 1 the discussion, while \another takes notes on inter- 
action* ' 
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c. Field observations / 

Direct observations are liiade in classrooms, at meetiiigSi 
during interview aria^a^^^ sessions, ani^erever sdiriething worth 

noting is h^pening. it is ^ important ^t^^ recdraea immediately, 

either in writing or spbkra^ c^^ In aaaition to the direct recbra-^^ 

ing of actual events, field notes also include the observer's perceptions 
of , reactions; to and insights stemming frbiri tjibse .events.: The sjciiied 
-observer-irs^eeiily-^i^^ 
qualitativeLdata; the first indicates what occurs ^ whereas, -the second, ^ 
equally important, represents ati int^rp^ ' 
means . The best f ield notes are vividly descriptive ,^ ^ i^^ both types 

of data and making clear where one stops and the other starts. - 

Anecdotes .and informal conversations inay b sufficient' 
to create their own categories of interact ibSal behaVidr^ of t'espdnses to 
institutional/and iiwiSbnS^^ etc. However, especially with 

observations made durin is far more likely that- • 

they will aid in the interpretation of larger and more systematic sources 
of infotinatibn, such as questionnaire^^ or interviews. 

Mi bbseryations are typed arid eventually used to augment 
data from other sources, or if comprehensive and extensive enough, to serve 
as £t f Uliy independeht dita sourti. Each trariscrip t ; is initially ^ass±f ied 
acx:oraing to the s^^ ©f the bbservatibn: classrbom,_cli^ical vi 
conversations, etc. The later oirganizatlori of ^that irifdrmatioh depends 
u^&n its substantive cbriterit arid the relationship of that content to 
specific areas of research iriterest. . ' ' i ' ■ » : . - 

l_i______d.r— Prbgrairi documents . ^ ^ - ' 

\ ' ^ Program ^bcuirierits 

bri riew-^traride\^r^^^ names ^ to ribti(::es of student activ- 

ities, to detaiifed-curricuiuiri brb to lerigtl:^ expositions of depart-: 

mental Review. ; Documents are virtually any- 

-thirig^ written that ^caS l^ up duririg a site :visit and which pettain 

to the ai:;^as bf in<iuii:y iri the study. 

/| . ; >' 'They are brie sbUr^ data for :estabiishing fbrmal arid 

irifb^l mariifestatid goals and hbw they ire. implemented 

In creatirig 1 second step m^^ bur tactic is to look f 6r the extent to 



which , there are siiniiarities of ^requirements and themes among the six cam- 
puses, to determine common goals ah^ means of achieving them; Our primary 
intent. is hot to "raeasure'Vthe extent^^^ actually conform 

to th^ gbalg tlley \set; Rather, we: use the dbcuineht review to define the 
goals and methods coSinoh. td the pro grams ^ as well as to note variations 
arid. discrepancies among them» . . * \ 

,: Documents are approached; first by making, a irecbrdirig 
"sheet^^ndicatiitg^ space for 

making notes.. For exarapie, we make notes on the "curricular structure" ' 
by tecdrding which courses S student, must and. can take^ ori the influ^nce^ 
of subjects": outside the nursing departinerit arid so bn.\ As these sheets are 
filled in, some areas may be abandoned as inapplicabl^^. arid others added 
that were not anticipated. We process information from documerits by 
extracting and classifying segments that we firid revealing, but we add to 
and subtract from those. topics and classification schera^^ to what 

the documents tell us is significant. Does the nursing program have a 
special recruitment policy for men? Write it dowi undii. "admissions 
policies." Did you finda hand-out sheet announcirig a group to air student 
complaints? Depending on content, it may pertain. to "f acuity-student inter- 
action," "academic standards" or elsewhere, but write it down. 

Some' infoffiatibn gleaned from dpcuirtiBrit^ can -be coded and 
entered into the. quantitative "pro gram data-set" (see page.87) , but it lends 
itself ^tb Biuch broader usage as well.-" It can help to. guide the iriterpre- 
tation of specific findings^ arisirig from other sources, and it can provide 
insights. useful iri formulating a theoretical- model of second step riursirig 

" ' - " \ ■ ^ " 

education. 

In prbces^irig qualitative data, the researcher attempts tb 
"use" all thd information which an individual respbriderit pirdvides—not 
merery facts but the attitudirial and affective context in which the facts 
are giveri. In doing so, the person who prodess^^^ raw data actually 
it^oses his or . her own thbUghts. about the material upon' the data. Since 
this is essentially a subjective process, it is advisable tb have radre than 
.one person review qualitative data. This ndt only furnishes additional ' 
perspectives on the real "meaning" bf what the. respondent has written and 
how respbrises shbuld be classified, but it also aids in the recogriitibri 



and^reduction of bias oh the ^iart of the researchers; . 

2 . Quantitative data . • . , 

" : ■ ■: Processing l&rge quantities of quantitative data requires / 

accuracy, arid attention to detail, if the- brlgirial responses are not 
recorded accurately and in the correct places, all subsequent analysis 
will be meaningless. Great care exercised here will be more thari^^ 
"c"iirtea"afc"eac'ff^^ 

a. Cddebbbk ' » 

In order to know how to locate any piece of data and* to 
provide instruction- to coders and keypunchers, write a complete codebook 
for each instrument that provides quantitative data. This document has^ 
mariy "Uses, and there is undoubtedly a. direct correlatlbri between when it 
is . written and the number of serious data-proCessing problems, you will 
later ericburiter. As an example of format, the first page o^ the NSSP 
codebook for the Entry Questionnaire appears on the following page. 

The first two columns give the location of the variable 
—the dard and cbluinn(s) in which the informatiori is stored. The third 
column is left blank. Raw frequencies can "be added when they are available. 
The f our^th column reports the source of .the information—which item on what 
Iristrument produced the Variable; The next cblumri shbws the name you give 
to the variable; this can be either a defining word or abbreviation, such 
as REGION or GPA; or it can be a sequential alphariumeric listing, such as" 
VI, .y2i etc. Next comes a label for the variable, the codes Snd labels 
for the codes : Most, computer programs have provlsibris ■ fbr . labeling vari- . 
ables and values but restrict the number of keystrokes (letters'or digits) 
allowable for this purpose. - 

• ' Codes should be definitive and" mutually exclusive; cbdin", 

' ■ _ _ _ _ _ _ _ - Li 

categories shbuld not overlap. As far as possible, code similar responses 

to different questions the sairfe way' throughout the survey, such as no =1 
arid yes = 2. Make allowances for missing data; not" everyone will answer _ 
every question and some people will not return all instruments. Open-ended 
questions require special treatment, as discussed in the following chapter 
(see pages 77-79) . 



ENTRt QUESTIONNAIRE CODEBOOK 



1-5 
6 
7 
8 
9 



10 



12-13 
14-15 



16 



17, 



Item 



VAR 
Name 



Variable 



-Values Labels and Cdd^ 



El 

32. 



E3 
E4 



E5 



E5 



ID 9 

6-2 . - 
Quality eontrol 
Card No. - i 
Consent: 1— Yes 
2 - Ko 

Parents hJf/nest educational level 
Father 

^ether^, — — - — — - 

1 - Some H.S. ; 

2 - H.S. .graduate 

3 - Vocatibhal/busitiess. tra5:ning 

4 - Some Hbllege ; 

5 - Two-year. college graduate 

6 - Four-year college graduate 

7 - Post-graduate study 

8 - Master's _ 

9 - Soctoral/Professidnal 
b - Missing data 

Parent's dccupationi 
Father 
Mother 

02 - Seint^;S^i\^ 

s^ki^^^a manual' 

fcal and sales 
V^iifnbr prof esisional ^ 
^ Lesser prof essioTtai 
y/ - Major prof essibhal _ 

08 - gomemaker, hoUsevjif e^ student 

09 - MD* RN or medical professional 
99 -.Deceased/not applicable 

66 - Missing data, but applicable 




Patents' 
1 



income 
Under $5,000 

2 - $5,001 -10,660 ' 

3 - $10,0Q1 - 15,688 

4 - $15^001 - 20,000 

5 - $20,001 - 25,000 

6 - $25^801 - 30 i 000 

7 - Over $30,000 

8 - Have tio idea 

9 - Not applicable 
d - Missing data 

Religibn 

1 - Catholic 

2 - Jewish 

3 - Protestant 

4 - Other 

5 - None 

0 - Missing data 
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ORU 

om. 



Where 
Reapries^ 



ORD 
ORD 



ORD 



NOM 



S4 



The last two coluinhs will prove useful in the analysis 
stage of your research • "Type of variable" refers to Its level of measure- 
ment.^ This aferts the researcher to the appropriate statistical techniq^^ 
to use with this variable, "Where Reappears" Indicates the variable name. 
when that item, reappears in- ano^^^^ This is for use iti „cdn- 

structing change scores or analyzing chatige data. 

b. Editing and coding . = 

Each questionnaire should be checked by someone thor- . 
bughly familiar with the. coditig;s cbdebook. S/he sbould 

clarify ambiguous responses .and decide the apiprdpriate codes for op^r- 
ended questions which are preclassif ied, such as occupational categories. 
Certain responses will require decision-making. For example, when a • 
respondent marks two responses to one item, or checks "other". and writes 
in a respohse that clearly fits one of the pre-coded -responses:, the person 
checking the survey decides how that response should be coded. These 
decisions should be consistent throughout the^ editing and coding; process. 

Apparent inconsistencies in a- respondent's answers also 
need to be dealt with. A respondent may say she earned $12,000 per month. 
Some clue may be available in other responses as to whether she meant v 
:$li;20b per iiidnth or $12,000 per year; dr something else. If there are no . 
clues to inconsistent data^ one can either code precisely^what the respond- 
ent reported dr cdtisider that response to be "missing." - 

\ ^Jheh coding categories have been derived for open-ended 

Items, the appropriate code should be written oh the questidnnaire next 
to ttie. respondent's an reviewed fdr clarity, 

cbnsi^tyndy >nd acc^^ is ready to go to the keypuncher 

or data entry operator. 

c. keypunching 

The keypuncher should have a copy of the questionnaire , 
and one of the codeBopk. ^It i^ recommended that each catd be keypunched ' 
atid verified for accuracy. : A verif^^^ a machine similar to the ^keypunch 
machine: it checks the ^ards as the data; is retyped and marks a ndtch^ in 
each coiuran in which there is a discrepancy. The data can, then be rechecked 



with the oi-lgihai questibrinaire arid corrected; if It is hot pbssibie to | 
verify the data as it is' entered, other methods of cleaning the cards are 
avaiiabii; sach as prbbfrM^ each card or "spot checking" every few : 
cards, 

After cards' are keypunched and ^erifiedi they should be 
sorted into Sequential ID order with second, third and fourth cards follow- 
: iag_bBhllLd_Jhe_first^rd for each ID number. This is done on a device 



called a counter-sorter which i7"a^miirWe"S"most coniuteF"centers"~ Then 
a printed listing of" the cards is made arid reviewed for obvious errors , 
such as the data ending in the wrong! column, or identification numbers 
being incorrect r The listing will also Show if certain cards -are missing 
for individual caSeS, and this error can be corrected. 

'-. . After you are satisfied that the cards are accurate arid 

in the proper order, they can be submitted with the neCeSSary computer 
program for data analysis. 



d. Programming 

Several software packages appropriate to the use Of 
statistical analysis exist. The most comnibri brie, arid the one that NSSE . 
usesi is Statistical Pfckige for the Social Scierices (SPSS) (Nie et al. , 
1975) •. its many advantages include the. availability of a well-written 
and fairly easy-to-follow niariual. It also has numerous sub-programs that 
allbw you to do most statistical procedures. 

Orice the iriitial program is written arid cbmbiried With 
the data into a systems file, subsequent analysis often requires only 
several liries- of programmirig. : On tlie following' page we have included an. 
example Of the, program for the fifst page of ^the Entry ..Questionnaire ; ' 



e. 



Debugging 



Debugging a program requires' executing a computer task 
using both your i)rbgrain arid ^d^^ and seeing that it makes sense, Iri SPSS, 
vise of the Batch format fhi debuggirig gives yOu a correspondence table 
fSr. checkiHg tb see thit each variable is being read from the correct 
ckird arid column of data. This; is a crucial check; the computer reads 
any niiibei iSd makes no judgment aS to whether or not that number is, correct. 
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file: H.-iHE 
VfiRlHBLE.LxST 
INPUT HEriiUH 
H 81- Gi^iSES - 
INPUT FQRHAT 

HissiNe yAi-UEs 

vAR LABELS 



EHTRYf FROfil^AH FOR Eiv:Tr?Y„ SUESTjaWNAlRE 

.IBM^DNb'ENrrEl TO El '5 

DISK • . , ■ 

■425 • ■ ' ■ - - - - - - • ' 

i- IXED ( F3 ♦ 0 )- 2X» 3Fi>0 » SF2 - y 1 J Fi ♦ 0 ) 
El y E2fE5 pEfi i- E/ - E.'.O 
Ei 7 FATHER' S , EDUCATION/ 
E2 i- H0TI-IERS EDUCATION/ 
E 3 » I- A T l-l £ R S 0 C C U I-' A T 1 0 H / 

E5H-'AREN rS INCdiiEy 
EoH'-'lELIGlUN/ : 
E 7 y i^l A l^• IT A L ; S T A T' U S / ' 
£"S f HUHBERV UF XHI'L BREri A l HOME/ 
E^fAGES BHILDREN AT HOHE/ 

EiOyLiyE;;; aldi^e/ 

ElIyLIVES WITH SF'dUSc/, 
E J. 2 y L i V E 3 W I T H C H 1 1- S !*< E N / 
EJ.3y LIVES WITH PARENTS tJR 
E iAyL 1 E 5 W I T H U N R E L A T E D -f 
ElDM-IARITAL PLANS/ 




.HcUi!:; LABELS . E:LyE2(I)30ME HS(2 

(5)2 YR eOLL(if>? 
.. • iE:3yE4(01)UN3KlLLE 
Cw4) CLERICAL 
vy8)H0HEHAI<C^ 

<5i)2Q 
• ■ E6(l)(: 





freqUenc-ies 



y 0 C 0 R B [J S<Ai S i-i C 0 1... I... : 
(•) NO DEO i B ) HHiiVi EPS ^ 9 ) DDI 

s i\ 1 1... i. . E < 0 > s i< 1 1 . L i:: i:' i-i a n u a i . 

r PROr <; 057 LESS PROF C 07 ) riAdOR PROF-' 
■DICAL pROl" <: ?'/ > N A/ /- 
1 0000 < 3 ) J.0002"":l5000 ( 4.) 11500 Lr>JO0OO 
5 0 6 :l. - 3 0 0 0 0 ( 7 i 0 U E R ' 3 0 0 0 0 (. 3 1 N f3 1 0 E A a •? 
JF.WI 3F.i (.5 ) PRbT ( 4 ) OTHER S S 5 NONE / 
^i.J.iTtJw^v^>H0RRXED<:3);DlV 'OR bEP.(4)WID0W^^^^ 

EacB)8 CI^OREfyJHAS-NT AT HOME/.^^ ^ ^ ^^-^^ ^ , ^m,' i r i« 

F'/<:0)NO-fSWIL.DREN( I'JYNG 5 OR LESS.^2At:Nb <;>--I2 ( ^ . Nb .l...vi« 

<4)YN0- 19 OR NORECSJNT HOME <19(,;.>Nr. .iDi-IE l;'r/ 
ElO Td ri4<:i>N0f CHECKEi:i(2)CHECKED/; , 
EiS\l-)WI 3YRS(2)3--5 YRS(3>5f YRS ( 4 ) NEVER ^ 5 > DONT KNOW/ 
GENERAL^fel TO E15' , ? 



01; .' Kl. 
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SPSS also has an EDIT furictidri that checks and points - 
•8ut errSrs ±S the program. After" the program is erroi-freei attach the^ 
a^ta and ruri frequencies for ail vafiabies. Check each variable for num- 
bers that are 8ut of range,' stich. as a "7" in response to an attitude scale 
of "1 to 5." If thkse:''i1npOssibie'' 'numbers occurs identify the case by 
ID nuiifcer , check the- original ^ of the data, and correct the, data " _ 

file. This b^^^^^ 

data are now ready for analysis. 



C. Providing Feedback to Par ticip ants :: 

The NSSpT like inbs|^ social an 
dependent u^ori the cooperation of a i^e^t many people--ribt only the central 
''and extended staff , but those from whom information is sought. In the case 
-••r^f tiie NSSP, these include program administrators, faculty, students, grad- 
uates and even graduates^ supervisors. Most of these sources a^e contacted: 
' : • iore than once during the cburse of the investigation. A jmechahism for 

maintaining a spirit of goodwill among all the^e ^hformants, and' thus for ^ 
encouraging their, continued interest and participation, is that of pro- 
■ vidihg them with some tangible' proof that the time and efforts they have, 
"given" have produced some worthwhile results. 

' The watchword here is multiple usage. As you process the' data^ ^ 
received from each sample and ^eady it for further analysis, consider .which 
' of your informants, as well as which other significant audiences mentioned 
in Chapterai (see pages 13-lA) , might find such data interesting and - 
"rewarding." in most cases, this i§ the only payment they will receive 
for the contribution they have made to your research ef fbrt^-a way of ^ 
saying "thank you ;'V SUt the same data :sunim^ consider the 

format ^ead of time, probably form a section of an annual report and 
perhaps .serve other dissemination functions as well. 

The Evaluation Associate on each of the participating campuses 
is the NSSP's lifeline to students, faculty and administrators. Until 
this point. in the project, they have functioned primarily as data collectors; 
. but once -the data have been collected and processed, they take on two addi- ... 
" tional roles. 1) They receive copies of all preliminary reports and 
findings from the* study which they can then make "available to other audi- 
ences bn each campus— botti faculty ^nd students. 2) They may also receive. 
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upan/teqUesti processed data reUtini tb particular questidns which they-; 
themseivercan then pu^itie by Using segments df the N3SP data base in 
cSnjbSctidH with their bwri Ideas regard^ 

. Reporting bick to other participants is less autbroatici though 
-ii5 less important. The Evaluation Associate informs both faculty and ^ 
student respondents that they may request findings from segments of the 

••study iS-'which-they.partiG.ipate. Such,.reques.ts -Say; cpme..in..t 

a letter, or may simply be jotted in the margin of a questionnaire or 
included in a "free commehtlry" section. Regardless 5f the formality or 
infbrSality with which the iequest is phrased, the wise researcher wiH . 
. respond promptly and courteously. If even preliminary findings of the 
type requested will hot b~e available for some weeks or mbnths, a brief 
note acknowledging their request and promising to fulfill it as soon as 
possible can go a long way toward promoting a positive attitude toward 
the "next" questibririaire that respondent will, recei^ve. 

" . . Special mention sholiid be made of the use . of qualitative data in 
this regard. As students respond to questions such a^ "What, did you find 
most valuable about the program?", "... least valuable?", "What changes 
would you like to see?" and so on, thef compile a veritable treasure chest 
of compliments, criticisms and constructive suggestions. The researcher 
can leirn a great "deal from; such- commentary , but another very significant . ' 
audience is. of c urse, , the -faculty and administrative personnel of the 
program beihg described or reacted to. enHe. the material has been typed ^ 
and all identifying marks teinoved ^ .these . typed transcripts can be furnished 
to the department Chair, who, in tuihi, can share them with faculty, com- 
mittees,. etc; Most academic progrims are continually striving fbr improve- 
ment; the frank and unbiased reactibns of their. students can be a most, 
valuable guide, arid will be greatly appreciated. 

How much feedback a study can realistically provide, to partici- 
pants, of , course, depends in part upon the riumber of participants. The . 
NSSP, with some twb thbusand respondents ill told, canribt hope to send a 
report of findings to each prie, although a small single-campus study Might 
find this feasible arid WorthwhileV We do , however , furnish brief suiSnaries: 
of findings to key personnel at each campus site whenever possibPe, encour- 
aging each recipierit to make such feedback available tb bthers as they see 

...'fit.' ■ ■ ■ ' '' 
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One word of cautibri: aithbiigh i,t is our intent to be geheirbus 
with the iisefiil irifbtination we^^ o as /we gb albtig rather than to keep 

s^it needlessly locked away from view until publication, some care needs to 
exerted in. the manner in y hlch this is - done iiv brder to. protect • the . 
l^gitiiiikte inteteits of the ^i^searcher ,• The release of specific bbdies 
of^ data inust be gcrutl^^ Qaalitative data, such as 

dir^ect quotes from questionnaires or interviews , must be screened for 
Idrntifyiitg naines ahd^^-p^^^^ quantitative data, such as ; percentage 

distributions ai^d sample means, can, in some cases , be "sensitive inforraa- 
tion.\" .They should be, free from all institutional identification prior to 
Release to an outside audience. Finally, the Researcher must take care 
to emphasifT'thl-^^re^^ naturae of all pre=publication ifeleases , 

scrdpulpasly avoiding the statement of "final" conclusioHs and/or recbm- 
mendatiLsi and informing the potential reader' tliat. early indications of 
jEiridihgsUie subject to change as the analysis progresses. . 

D. Responsibilities , Conmiunicatibri and Continual Secis ion-Ma king . 

We have already described the research team: seven central 
staffers an^ six associates "in the f iald . " (See . pages 45-48 . ) Cbbrdina- 
ting the 'ackvities of this group calls for the Setting up of areas of , 
Resporisibillty, channels of cominunication and . d.ecisibri-making prbcedures. ' 

Research brgariizatibns, like any other iwork.groupi can r 
from the highly centralized to. the highly decerittalized. In the former, 
one persoS of i"of f ice" actually does the research with pr without the help 
of other pebpll and/or services; in the latter ^ 'the .whble team is inyol^ed 
in all phases ^f. the project. Each has its adyantage^ and disadvantages, 
but the very nature bf the work undeitaken byS>,the: NSSPV iriterdis^c^^^^^ 
dtf itJcus. and explanatory in its ultimate bbjectiyeSi &rgnss f^r a non-^ 
bureaucratic . oi decentralized approach; Eich 'feeri^ the.tkam .is account- 

able/in sotiie mUsuie to one another ^ but is primarily ;.acconntable for con- 
tributing to the overall achievement ot- the long-range and intermediate 
goals of the project. • I ' : j- 

': / . In a decentralized or "hbrizbrital" .organization, communication , 
ii|siies, a place of ' primary importance, Alth^'hgh' every member needs time ; 
anf space to work indeperideStly, freqiieht intie^ since most, 

±|j'not ilii decisibris affect. -not ohe but several aspects of the integrated 



research design. . , i 

Among the central staff members > weekly meetings are heldi with . / 
ah open agenda cbritinubusly posted for each;researclier to jot down topics, 
that warrant the attention of the group at the next meeting. Flexibly 
defined as "team meetings, " these can take the form of >tudgetary discussions,, 
crisis intervention if an immediate problem surfaces|/br seraihars for sharing 
■^uEstintive research interests. Beyond tWiri[±ffcus^6n time, drafts of all 
written work emanating from dUr research are constantly circulated •'amongst 
the team for cdnnnentary- and critique. 

Face-td-f ace comm Evaluation Associates is 

more difficult, but equally necessary. A two-day orientation workshop 
scheduled very early^in Year 1 brings the entire team together in one 
place for dlscv ion and further planning. In years 2 and 3, invitational 
conferences coiiLlntie to serve this purpose as well as that of presenting 
project outcomes to a wideri audience. In the Spring of all three years, 
members, of the central staff travel to each participating campuS for 
consultation as well.as for data-collection. Finally,: these f ace-torface: . 

contacts are supplemented by a system of telephone contact arid by frequent 

. \ ' ■ ■ . ■ ■:■ / 

correspondence i ^ . ' ■ ' ^ ; 

; i There .is no denying that such an elaborate cbraraUnication scheme 

is costiy to inaintain,/botK in travel dbllars and in professional staff 
tirae.U Detnbcracy was never noted for its economy and efficiericy.. Noriej- _ 
^theless it . represents a system which we feel is highly appropriate ?o our 
research objectives ; 1) it permits each raeraber-to work semi^autoribraousjlyi ^ 
thereby encouraging creativity and encoitipassirig a diversity of work Istyles, 



but 2)1 it alW insures that all: major decisions raade^ which occur with, 
alarming frequency, have the support df thdse whose work they necessarily 
affect! Especially for a- complex research design involvirig ah inter-l 
disciplinary approach, we recommend it as slow and expensive but, in the 
long run ^ cbst effect e. ^ ' j 
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Notes 



Since Such of, the^NSSP is m outgrowth of our previous Setnonst ration. 
Study,, we carefully reviewed_what had been learned from that experience^ 
wire ail. the instruments useful? Couid they have been more productively 
used? : Whicfe specific, items w^ redundant^ arahigudus_ or gther^v^ise 
.expendable? ^at did \^e want to know that was not asked in the previous 
st udy? 



a]. 



■ ■ ..■ ^ y ' ' ■ " . ■ _ _ ...... _ . . . . J 

2» Many studies/have; discussed the effectspf">ttritidn in longitudinal 
^^researcfi (Vollbrecht , 1977) . -In the NSSP design^ although the "total" 
ddngitudlrxal target sample (Class 4) numbers approximately four hundred . 
at entry, the';^separate sub-samples, by participating program^ range 
V from a high of n=12Q,:tb a low of n=»32.^' We, therefore, set a minimum > 
• acceptable, response rate at 75% for Class 4 entry-level, data.* 

3V tSrT^ebreticaliy, this has the effect "'of limiting the student interview 
' sample for* Year 1 site visits io Classes 3 and A, and for Year 2 to 
/ Classes 4 and 5.' In_ reality-, ^students frqm the earlier samples (Classes 
i and 2) may be still enrolled/ due, to part-time attendance or "stopping 
out" fof^ne or more terras. . ' . ' 

i\. Laughter, for example, can express a variety of emotions. Consider the 

difference between these four accounts of a hypothetical event: 

' ' k • - ''^ ^ ■ ' - „ " " ' 

"Vj, laughed and left." 

"J. giggled nervously and hurried away." (She seerai? embarrassed; 
doesn't want to pursue this conversation. ) { 

I ^'J snorted and Stalked off;" (I think sfie was offended.) 

"J./ chuckled but was .called avay before she cduidi reply ."^ (Seems 
. interested and sympathetic.) ' * 

^\ _ . _ ■ ' ^ _ : .... 

5. SGM = Nominal^ OKD = Ordinal; INT = interval ;^;DICH = liichqtbmous. 

rS^e. Chapter V, page 88, for description and definitions df the first ;^ 
^tffiree levels of "measurement • A dichotomous variable is brie in vzhich 
3 there are drily twd choices. - 



. . . ; CHAPTER V 

' ' : : • - . ' ANALYSIS: Producing "Fiiidingis'V 

The arrangement of topics in this manual, has been seemingly 

. , ■ . ■ ■ _ . . . ■ ' - _ . - - - - ; - I - — 

seqiientfal: from design" to methodc^logy to the cbllcctibn. and propessing , 
of data, an3 to be f oliowed n^ -i" j 

a longitudinal study;, 'however, the 'latter part of that neat sequence is , I 
mostly myth. Firom the day the first data are returned ^ the next three ■ j 
parts of the •'sequence"— processing, analyzing arid interpreting—are set ] 
in motion, and they proceed more b!r less simultaneously until- t^e final 
report is edited to everyone''S satisfaction. Nonetheless, this chapter 
cbritiriues the theoretical sequence. • 

Clearly^ the analysis , of qualitative data presents problems 
duite dl-stiriet; f rom those presented by quantitative analysis . Each employs 
it^^ own Strategies to reveal and support its bwn findings. Their roles in 
the research process are complement they share a common goal: tb 

extract from thousands of individual bits .of Information a coherent body 
; of new knowledge sufficient ll^both scope and ^accuracy to address the NSSP 
research, aims. ' \ 

A. Qualitative Analysis,.. 

The NSSP research design includes the analysis of qualitative 
data relating to all three major areas of research interest: (1) student 
characteristics; (2) educational patterns and milieu; and (3) types or 
processes of academic and professional achievement. In the preceding . 
chapter-, we d'is cussed ways of processing such data from each of the instru- 
ments and/or techniques used. That data processing produced, in each 
case, typed transcripts. In the case of questionnaire ,iLem9, interviews 
and formal discussions, the typed transcripts represent the sum total of 
all the verbal evidence that has been collected. In the case of field 
nbt es and " do cument" Reviews , the transcripts represent a selection of 
e^ridence chosen by the researcher as bein g particularly informative and 
revealing. This -chapter pertTins to the next level of activity: working, 
•with -the transcripts , in order ^to-generate f iridings^which, - combined with 
' those,' produced by quantitative fahalyses, will he helpful in addressing 



the quistioni and thereby characterizing the Sec5nd St^p model ;Qf nursing 
education'; ' 1 v 



^coding cate 



a. 



Open coding 



a certain sa: 



Vmen cert^n questions are ask^^ 6f\s. res-bndetrt^^-rin. 
e to which they "write in" rather than! "chu. a response,; 



the phrases Cor .paragraphs! )l with which^ answisr such queens are 



a iricdrporated into what may be pri- 
.on tool. Several such It^ras are 



qualitative data even, though '* 
tnarily .a "quantitative" data-, 

included -throughout the NSSP instruments. For exkinplje, the las£ item in 
the Entry Questionnaire asks: ^ "What ^ai^e your long-range plans £br a posi- 
tion in nursing?" The very manner, in which th^ question is posed^is 
purposilfopen, allowing for alvariety of responses rather than sj^ecifying 
categbrijss^ such as: ^ . \ \^ 



in host 
in clinic 
in conununity 

or: V 



_ direct care 
- supervision^ 

adttiilnistration 
♦teaching 



or even: 



td attain a leadership role 
tbgcdntinue my current role, 

and increase ray salary | 
to' work part-time^ f dr supple- 
. raehtary family incdrae | 
no long-range plans fbrraulated 



^; : ^ -^^^^ assume that every student, writes something in thar 

space- ;The task of the qualitative; analyst is. to^view those response^ 
..ij^>.-^^4«^ ■h^.Qf ij:.vr of ^xtrkctihK meaning (s5 from thein that canj 
then be coded and" entered into the data set. We refer to the process Sjj 
wtiich thi^ is accOffipiished as "open" coding. It appfies to the handling 
of miiy other ty^es 5f qualitative data besides merely coding questionnaire 
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^espoSses; but sihce this is perhaps its simplest appiicatibhi arid usually 
the brie which needs to be done first; it is disctissed first in that 
bbhtext . - ^ 

Essentially i the researcher reads through all br^ if 
that is irapodsible, through a ^ip«sehtative saraple of the written responses 
to a given question. This is not in brder^tb "assfg^^^^ each respbnse to a 
' p?e-detemined -category^ but rather to arrive at the most useful way (s) of 
categorizing thera. The responses themselves, in: conjunctibri with the 
thebretical research interests which caused the guestiori to be asked, are 
thus the basis upon which the categories are built. 

^ , ^ ■ . A ; - - - --- - ■/ i 

Two things are worth rioting here. First, different 
' classifications of responses may occur tb di_fferent readers. For this 
^reason, it is useful tb have rabre than one person review the transcripts 
and discuss the categbrization scheme prior to its f ind -in:corpbratidn 
iritb the codebook for that instrument. Secbrid, it is not uncommon for a 
single qualitative item to yield mbre than one set of useful categories. 

. " In. the example given, '^our Ibng-range plans^ f^ 

position in nursings" the data' might well include enough Infbrmation to ^ 
•permit codes relating to "type of positio such as: 

. ' Public health nurse ' 

SchoQ^- nurse ^ 
• Hospita:! adininistrator ' - 

. J Nursing faculty member _ . ' 

Etc. (Th^^cbuid be quite a long list.) 

But they might also contain information that could be coded along a dimen- 
sion of theoretical interest fo researchers, such as "clarity of long-range 
goals," which might \ run something like: - 

No long-range plans stated, either within or . 

■ '\ outside nursing . .. : 

- No long-range plans with respect to a nursing position, 
. but some future plans are stated 
Long-range plans in nursing, but vague or tentative 
. Long-range plans in nursing, clearly stated , 

In general, then, the idea is to. use what is there to 
best advantage, trying not to duplicate information that is coded else- 
where, "losing" as little as possible from the sum total of the data 
provided, and keeping in mind the theoretical interests which stimulated 



ydiir asking the question;, ' 

When the classification scheme(s) and categories are 
.decided upbii /write t^m possible as to how 

the - distinctions' are to be drawn and including several examples as guide- 
iihes; At thit pbimr becomes e variable^ arid 

th^ catego^^ codes. Continuing with the examplergivcri above, we^. 

might derive two^ (or more) varfables: ; . ' ; 
(First Variable) tOrig-rarige plans: .Typ^ 

(Codes) 0 - No informatiori re: type of position, or nc response 

1 - Public health nurse , . 

2 - School nurse^ . . 

3 - Hospital administrator . . 

4 - Nursing faculty 

' (etc.) . . ' ■ . 

'9 _ Not applicable, (no plans for a position in nursing;, 

(Second..Variabli): toHg-range nursirig p^^ degree of clarity 

^ (Codes) 0- No iridicatibri of degree of clarity 
.1 - Relatively vague or 'tentative . 
2 - Relatively ciear-cut 

9 - Not applicable (no lOrig-rarige . nursing p 

The researcher, has now "quantified" the qualitative data 
from that particular questionnaire item. With the variables and the cbrt.s 
defined and specified, tlie next step is^ to go through the-eptire Sainple ' 
ind codV the , item by assigning the code number that starids for whatever 
.each resporident has written; Those codes Ire entered into the quantita- 
tive data: set. as representirig what that person h said in answer to that .. 
question. Again, since this is. an interpretive process, different coders 
Say interpret a response differently; inter-cOder reliability is discussed 
later. in this chapter. ; 
b. Global coding 

A second type of- coding often undertakeri with qualita- 
tive data! is called "global" coding. In this process, researchers make 
use of a broader range of information than that supplied in response to a 
single it eS. They may review an. entire! instrument or even a Set of instru- 
\iiSti from a single respondent, with an eye, to characterizing those responses 
arid thereby- iridirectiy chafacterizirig- that ^^r^^^ — 



. In the demonstration Study (Ja^^^ 

' txainpie, r^s^arche^i became interested in the general "oriintatioS toward ; 
nursing" with which students entered a second step program. Althbup rib 
single questionnaire item "asked" such a question (indeedi it would be 
• almost impossible; to ask!), pieliiniriary findings 1^^^ 

Suggested that it wis an important area for. exploration. By reading 
through all the qualitative data that students furnished at entry * several 
classification schemes were suggested and discussed. The brie that was . 
firially selected as -the most promising entailed looking at each student's 
answers to a group d£ open-ended questibri^ and ascertaining from that 
infSraation how each studerit seemed to view. hts or her role vis-a-vis the 
nursing prof essiori: 1) Traditional, '2) Academic, 3) Leadership and 
4) Frbritiering. Eacli "oHentation" was carefully defined arid exainples 
-were given. Five specific variables were derived from these data. 

The first four could be thbUght bf as attitude scales, 
each pertaining to one of the above-merit ion ed orientations and coded as 

follows: ' - 

0 - rio qualitative data pertaining tb nursiflg brientation 
• • at^;entry:. ■ ^ 

1 - ho eviderice of this orientation - , ,1 

2 - some evidence bf this orientatioS, but ambiguous or _ weak _^ 

3 - clear-cut evidence bf this 5ilentation, .relatively strong 

, • . The fifth was a nominal variable and entailed a ju ont 

' , btt the part of the researchers as to which of the four prieritations was . 
^: / ■''^oxcdMsr;^' f br this particular respondent . Thus the categoriei for coding . 

this ,^Hri^ble were: 

0 - no qualitative data pertaining to nursing orientation 

at entry __ ' • 

- : 1 - Traditional orientation dominant 

2 - Acadeihic oyi^ntatipn dominant ■ / 

: ' 7 3 - Load^^^shi'^ orientation dominant _ . 

4 - trpntift-riTrtg. orientation dominant 

; ; As with cpen^-coding, the next step is to go through 

tbe entire sampxe anu titiue j.ej.cvain. ^.n^w*......— v,.. ^ — --o - -o • 

■ * ; cbde riiimber that best Represents whatever each respondent has written. 

Resulting codes are entered iritb the quantitative- data set , replreseritirig 
iVeiythiiig which serves to iridicate "nursing. 



brlpntstiim*' att4 the researchers'- jU(igiheht or interpi:etat±5n of that 

■ ' ' i 

: strategies and butcbtiieis 

thriving coding categories for questionnaire items is per- 
haps thc-siinpiest form of qualitative analysis—a mere starting point. 
The basic mental process involved in both open coding and global coding 
are:t0 ioie extent characteristic of all qualitative analysis: reading ^ 
or otherwise assimilating the empirical evidence that is available, and 
arriving at a defensible judgment concerning the classification or Inter- 
pretation of that evidence. But whereas the desired outcome, in the case 
of questionnaire data, is usually the 'quantification of prose responses- 
such that they' can be entered into-^he-d^a set along with other responses 
iron that instrument, this is by no means the goai of most qualitative 
analysis. " , 

a. Defining areas of research interest 

Semi-structured interviews with faculty a^^^ : 
tors, group.di^cussions with students, observational field Sotes and -a 
variety of documents from each participating program furnish a formidable 
morass of evidence to be assimilated and 'transformed from "processed data'- 
into findings. The; general idea Is to orient oneself in some useful direc- 
tion and to set some priorities before pushing headlong into the unknown. 
For the qualitative analyst, the best guidelines are the research questions 
which Originally stimulated the coiiiction of data. What s/he- learns may i 
extend beyond the "answers'* origihally so^ught, but it should go ^t least 

■ as far. '■ ' - ' ' ■ ' 

. Looking back at page 16, it is easy to compile a long 

iiit bf rese.trch interest areas. Many, l->wever, are most efficiently 
addressed by means ox quantitative data, so in setting priorities we leave 
thbse aside fov the moment arid look for areas -in which qualitative ^^assess- 
ment is likely to' produce the best source of insights ..^cgricepts and findr- 
ings. A prelimlriary-rlisting, of suc-.h areas includes: 

--1) Information about students, with regard to: ,. '/ 

. personal -goals and changes in goals 
• * . professional commitment 
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2) Information about, educational p 

. administrative \ 
. admission icriteria_ _ . - : . : . _ \ 
; 'than if eif^tat Ions of program objectives ; \ ; 

3) Patterns of personal interaction among faculty, students, administra- 
tors and health professionals \. . 

4) Teaching styles ^ ^ \^ 

_ , ■* ■ I - ■ v. 

5) 'Carricular designs : - \^ j 

.6) ::-Regiohairbistqri^ institutional; contexts within which prograi^s 

develop * \ \. . 

7) Indications of program development, with regard to: ' \ 
. . program objectives: , ^v;^ 

liow expressed, fbrmally and informally \^ 
, - means of iihpiementi strategies for achievement 

: i organizational structure: 

^ . . how formulated 

evidence of stability ana/ or change 

8) Contributions to the nursing profession: 

. perspectives on the prof ess.ibtl 

; definitions of nursing roles . 

V ' . This is not to say that onl^ 

to illi^minr.te Inese areas. But just as quantita^tive data are better 
siii^ed ^ivo7idins^ for example, >tuden^ on demographic and person- 

ality -ibutes, our qualitative data aire mo^e useful in examining, for 
ekSmple, faculty teac^ 

ultimately exi)lb^ by donsic?eriSg the- sium of our knowledge gleaned from 
-:^^--^ ~a3d sources and research strategies. In the above a^eas, qualitative 
analysis is expected to l^ad the way. ^, j 

Finally it is well to remember that although the list 
of topics is- already quite long, an overriding characteristic of quali- , 
tative analysis is its ability t5 accoimnodate and intellectually exploit 
theu^ In that sense, the list is considered tentative until 

the 'inalysis is complete. 
, ■ : ; b. Organizing the data , 

' The list of research areas best approached through the 
, . ^ arialy^^ of ^^qualititive cjata is the, starting point, for tHe. systematic • 
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karidiing. bf a iar^^ ihf brmatibn. These are the thiHgs 

: ' abouvwfiich the afialyst should be able to speak authoritatively at the end. 
5f-the :kalysis. New topics and sub-topics fiay be. added during the course 
of the investigation, but none of the basic areas can be ignbrecl. 
: .. Cbiiection, processing and analysis are carried bri siffiul- 

• taneousiy over an extended period of time', each^serving tb direct and 
. refine the other two; AithSugh the. NSSP design includes only a Sidrbscopic • 
' airiount of "fiiid work," when compared -tb studies which are built around • 
the use of participant observatibn as the priSary research strategy, still 
the investigator has -soffle . opportunity to develop ideas with regard to a 
particular area, and then t5 go back "into the field" in order to tfest 
out. those ideas--to see if they cbritinue to hold water in the light of 
new evic'Ji'ince collected. . 

tet us consider^ as an example, the fifth area on the 
preceding list: curriculSr design. A catalogue description of a program 
may provide the initial clues about its curriculum. Ideas formed by reading 
the catalogue may be further refined arid- developed : by reviewing information 
. furnished in tke Faculty Questionnaire; whSt; faculty members say ^bbuL . the ; 
. .curriculum may conflict with^ the catalogue description, or it may merely 
clarify the "bfficial" description. The first Site visit then provides 
an bppbrtunity for finding out more abbut the . curriculum and for observing ' 

iinplementa.tion--talkihg tb faculty, to students and to admiriistrators 
as well as bbserving in classrooms and clinical practice settings. And 
-he evaluation component bf -the Graduatibn Surveys completed by gradu- 
ating senlSri provides still anbther perspective. As materials cbntinue 
to accumulate, the researcher's original notions concerhirig this one 
area, curri'Ular design, may Fe considerably reVisid, strengthened or 
\ fbcused[ unifyiiii concepts and therues may emerge, or disparate percep- 
tions may signal divisive elements which need to be explored further. 
The^secpnS site visit provides the final opportunity fbr "bn the scene" 
questibning arfd observing, although pencil-and-paper data will continue 
tb accumulate until the. end of the data-collection period. 

Since currlcular design is onl> ouc .i: a nuiuuer of 
: areas ekpio^ed' in .this fluid irianner--constantiy working back and forcH 
between the formulatibn bf ideas and the further testing but of s^c-^e 



ideas in the light of additibhai evidence—some method of brgahizihg the 
empirical evidence as it accumulates of the utmost importance. 

It is v.irtuaiiy impossible to "tell" a researcher how - 
bist to deal with a large body of qualitative diia su'ch as that collected 
over a three-year period in the NSSP design. The number of methods in 

; current use is. probably about the same as the number of qualitative 

.analysts. SoSe prefer to work directly with "original" materials, making 
marginal ^ptes, ' color-coding With felt pens, developing and elaborating 
upon (or discarding) cOJ?et5pts as they go along. : Others may set up elab-^ 
orate card files, indexing and cross-indexing as they go-by topic, by 
source^ by time period, by type of data, etc. Still oSheSs p^refer to" 

■work more dr, less ointultively, jotting down notes and ideas as they read 
throu^li tire materials, making theoretical connections and then going back 
to search for iiitastrative examples and clarification. The most common 
approach is probably some combination of these various methods. None 
are infallible^ and' none are "wrong." 

o . . .The bottom line is that the data will be most useful 

.when they are somehow grouped around the important rese-irch areas to which 
they pertain. Exactly how this is accomplished depends in large measure 

'upon the working style of the research team. When th6 final report is 
written, however, the researcher needs to be able to reach iiato^a file^df 
materials related to each of the ma jof'areas addressed, and to find therein 
empirical evidence adequ. :o support inferences, concepts ^nd concltasions , 

7 c. Outcomes of uitative analysis 

The kinds of research activities we ^-ave described can 
yield outcomes of several types and levels bf generality. The simplest 
' process. is the derivation of coding 'categories for single items from 
questionnaires or structured interviews. It requires Jooking at only oiie 
bit of .information from each respondent. At the next level is the deri- 

•Vation of global boding categories for single respondents, each of whom , 
has provided roughly equivalent "amounts" of .information to be considered. 
This is a more bomplex prbcess, in that it requires ah overview of several 
Segment s bf data arid an iriterpretation of the combined "meariirig" af those 
several respprisesv such ^t^^ cari be characterized or 
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described in a certain «ay. Both theise activities * however, yield simple 
ciassifications of responses and/br of respohderits . The raw data; may come 
from either questionnaif es or structured interviews or both; the oSjective 
is to "quantify" the qualitative data so that the information is thereby 
Available for a variety of statistical analyses along with several hundred - 
other bits of information. . ' ■ 

; ;' . Most, qualitative analysis, however, is not aimed primarily 
at quaritificktidn but rather at the generation of ideaS; and concepts, and 
at' kfchieving some irisights into . the v/ay these concepts go together to 
"explain" the phenomenon und^r investigation— in this case, the second step 
model of nursing education as represented by .^e six :participatini NSSP 
prbgrams. Although the cognitive processes invbived. in open-coding and. 
in global coding— essentially reviewing and interpretiug the evidence, 
that has been cbllected— are characteristic of qualitative analysis per se, 
the overall objective is much broader. Rathfjc than understanding a single 
respdrise from a single respondent, it contributes' to our understanding of 
the. dynamics of a "complex social phenomenon. The desired outcomes, then, 
are concepts which serve to e3?plain that phenomenon. . 

' ■ ^ : In bur search for explanatory concepts, we review a. 

• miititude bf data emanating from six. campuses and pertaining to an. expand- 
able niimber of research interests. IS each area, the leading question is: ■ 
"What have we learned, io far, abbuf. (for example) student-faculty inter- 
action on this campus?" Think about it; review the evidence; a^x^ down 

.what you "think ybu kribw; discuss 'it, with others; come up with ^descrip- 
tive suiiimary— a paragraph or a couple of pages, but something. Then 
proceed to the next campus. When you've reviewed and summarized the know- 
ledge gained from all six campuses, you may have generated a number of 
possible explanatory concepts--ideas and themes abstracted from the des- 
criptive summaries which seem important and -noteworthy , either because 
of their ricurreuce in the' data or because of their relevance tb other 
aieas bf research interest. Fine. Go on to another area— teaching styles, 
for example— and pursue the same process again. : C ' 

that begins to sound like an endless" process, you ■ 

have guessed correctly; It/ii rarely under^ake^^ ■ 
bribed in the_prexious paragraphT'Sutr"it 4s carried on more br l^ss ; • 



cbStinbiliy. The payoff ^ However » is that eventaaliy the ideas arid cbri- 
cepts which "emerge from evidence pertaining to brie area cari be seerito 
relate to other areas is well; Since the object of the game is to generate 

"c&ncepts which help us to understand the dynamics of a complex -social 
phenomenon, the most productive and useful concepts are those which shed 
light upon more than drie aspect of the phenomenon under investigation. 

The basic assumption which underlies ail quaritatiye 
analysis is th'Bt the social phenomenon being studied, which can be as 
small as a single household or as la^ge as a giant corporation, is some- 

;iibw coherent; thus, tha^t it cari be -understood "as a whole," and that all 
asjsects of its functioning relate to that "wholeness." In the best of 
all possible worlds, the concepts which emerge from su_ch ari arialysis, 
although arisirig from' thousands of separate' empirical facts, will some- 
how "fit" with one ariother such that they combine to create an abstract 

but valid description of the phendmendn itself: i.e., what the social 

' ^ \ 

scientist calls a "model." 

<• 

B. Quantitative Arialysis 

Because the Sic5nd Step mod.el of ^nursing =educa4:ion is Relatively 
new and "unknown," the NSSP research bbiectives (see page IB) dictate au 
exploratory approach in both qualitative and quantitative analyses. Twrf 
impllcatioris of that approach. In the use of quantitative data, are that .. 
(1) the researcher works with a relatively large nuralJer of yaRiabies, 
any of which may play a sigriif leant role in the evaluation of this currlc- 
dlar model, and (2) s/he typically employs a variety of statistical tech- 
niques iri order to learn how these variables rel^t-e -to-one" another in 
this particular edii'catlonal setting. With lots of variable^^. and lots of 
statistics, it is easy to, get. lost in a maze of numbers which may or may 
not coalesce to tell' a coiierent story iri the final a^^ 

; Before we get into the details of quaritif icatlon, then, a few. 
words of general advice. First, keep at least one eye on the research 
questions;!!: all ti^^^ Each analytic procedure should serve the purpose 

of helping to aaaress cn^. .,aecoua, uai^c uxm^ l../. u.i«v.xow 

tical technique before yJxi use it--especially the assumptions upon which 
it Is based, fed, devise a way of keeping track of "where you've been" 
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as well as you're going;" Preliininair5| findirigs, in the form of ^ 

tabiesi graphs-'^and especially in prose can isrove valuable guided plan- ; 
nihg further analyses. They can pinpoint gaps, contfadictibhs arid puzzles 
in the data; 4nd they can help you know when ; to ^ stbp--either because an 
. analytic' scheme is "not working" or because a patticulaf ' question ha|s _ 
already been satisfactorily addressed. « J 

J/^ Although the next few pages are devoted to clarifying a few / 

^ ' _ _ • ^ •■ . • . , — 

^ basic terms i this" section is by no means designed to substitute for a 

..text on quantitative analysis.''" We present, in fairly general, tsirmsj,/ the 

overall design vf or the analysis of NSSP qusntitative data^ and a brief dis- 

; \ . . _ ' - .r-'— - - ' ' * j 

cusslbn of certain statistical proced^^u^^ implied in that des^ign. , / 

1. Variables ' ' i • . 

• Throughout this manual' we have referred glibly ,tp "variables" 
in many contexts, assuming that the word conveys a general fneaning to the 
reader. How long ago a student wa/s licensed as an RN, what ^a faculty 
member-,? s area of specialization is, whether an institution is, .publicly or 
privately supported— these af fe all variables in , that they may ' vary from ; , 
one^case to ariother. Iri research terminology, a "^/ariable" ±i an abs.trac- f. 
tion--a name the . researcher gives to a collectltTT of related categories. 
• Each item of coded information, ' regardless of hdW simple or how complex • / 
the reality it represents*^ is given a name and defined as a single vari- 
able with a very specific meaning' to which the coded categbries relate. 

A data set consists of a total group of variables which, 
taken together, provide information appropriate arid sufficierit for address- ^ 
irig orie or - research questions. A completed data set contains a spe- j 
cific number 3es, or units .of arialysis, and a specific riumber of ' - 

variables. The NSSP compiles three .d'ata • s^ts J student data^ where the 
number of cases (students) is approximately 2,000; faculty data, .where ■ 
the number of cases (faculty members) is apprb:*imately 80; and program 
data, where the number of cases (programs) is six. . 

: ., the number of variables cbritairied in each data set is " 

initially pq'ual to the total number bf coded items from all relevant 
/research. instrum_erits--perhaps a thousand foi students, less than a hundred 
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for faculty and even fewer ^bf .pt'bgsranis (e.g.* region, _ financ'iai support^ 
year accredipedi, etc. 5'. ;, (But* whereas the number of cases remains the saihej 
the huihher of. variables in all three dat? sets is subject to change through- 
out the study as°new information is generated. ThuSi although that number 
is specific at any given tim^i the final total is flexible ^^until near the 
end of the analysis. " . ^. . , ' 

' ' .2. Leyel^ ^ tneasurem ent: **'.., 

Each variable exists, at one of four basic levels of measure- 
raeiit which helps.^td. define appropriate statistical procedures for analysis. 
Most statistical texts contain a more cbinplete discussion of tliis . topic - 
(see, fo^ example, Siegel^ 1956). The definitibns which fpllowi however ^ 
provide the basic distinctions among the four types of variables: 
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Nominal,' where a characteristic is simply .named. Many of NSSP variables 
exist only at this leVel.' Obvious examples include type" of basic 
nursing program (for 'Students5^, are^ of specialization (for faculty) 
or public vs. privat^ support (for institutions) Even thoUgh/nuraer- 
ical cbdes are Used to designate categories ,| the numbers have no "value 
other than to differentiate types. \ 

■ ■ : j ■■ , . ; _ - : . ____ - ■ „ 

Ordinal, where a characteristic is^ liteasured feut only -in terms of "more" 
or 



'less." Mosflwof the^raany attitu 
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measures in the NSSP diata are 
at this level. The 'classic "example is"^ the .LiRer^-typd scale tunning 
from 1 '("strbrigly disagree") to 5; ("sftohgly alree"). The direction 
of the respbnsi is ileat. However; the^^preciseo"amount" of agreement 
or disagreement is merely in approximation; you can -assume that j the 
5's' agree "more" th^n the 4's, but you don't know how much more.:- » - 

Interval, ^vhere you [can measiire-distancejjetweett points on the scale 
as well as direction of the scal,e,.^but the unit of measurement and 
the zero point is arbitrary. Generally .speaking,, standardized' test 
scores I fit into this category, such as t^ose representea by the scales 
of thelOPI. If interval variables are coliaps^ed into categories, 
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howeverl" the- collapsed versigri exists at ^^e ordinal level, since 
it "no ipnge.r accouhtls for all of the intervals sfeparz 



tsparateiy. 

\ '! 

iu»LJLwj Where you car ^6t only measure distShce "between" the categories, 
but where cthere is always a true zero point as , its brigiri. Exa|nples 
include age', weight,' income, enrollment, etq. , * , | ■ 
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' sUtlsticaf prbcedures are designed for the various levels 
Tl^easur^entV the ;4bri pbwer^^ ones usually being appropr|-ate bnly for 
interval br ratio varial|les; Thei^ applicability fbr nbminai .arid ordinal 
ievelg- of 'measurefteSt his been 'the subject of much statistical debate; 
(liabb^itzi 1972 i pp. 13=^8) . ' ■/ : ^ ; 



• -r ■ ■ , . ' 

. ■ -i . ^ ■ . ' , 

\ j, ■ ■ - - 

/ ' ' Most NSSP variables arie at the .ibweir levels of measurement 



(ndinirial and ordinal) i' which could be viewed as a disadvantage in terii 
bf :4^rititative analysis. Gn the other hand, dUr objectivei d5 Sot irivblve 
us^ m formal hypothesis testing, and out number of cases, at least for the 
student samples, is comfortably large. We theiref ore select only those . 
/ statistical techniq -s " which serve otar research purpose! and which are not 
so "rigorous," in terms of measurement levels and/or sample size as tb make 
them inappropriate, for our data base. 



I 

S - 3. The anal^t4e 4eslgn- . „ . 

In quantitative analysis, ithS researcher-wbr^ -with one 
data set at f time. The largest data sit* as the analysi/begins. is the 
one pertaining to ^ stuients, which cont-aihs hundreds of variables about dach 
individual in tfieientire student sflm?: :-. These data are used to explore 
research questiks which can be tflc ■ - «ctly and usefully addressed with 
data from and a^t the students f olves. Looking back at the overall 
research dbjecti-is (see page. 16) * we can extract a number of areas aroutid 
which, to organizfe the analysis of student data: / 

1) General characteristics, iiiauding 

• -. geijfefal educational backgrounds 
; . types of pre-licensure training 

. . demographic^attributes and lateral roles 
. . MasUres of academic potent 
. measures of prior ;academip_ achievement 
. measures nursing knowledge/competence 
personality attributes 



2) Atti^d'inal attributes, including 

■ , / / - . - / - . ,■ ^ 

. general attitudes (yalues, priorities, etc. J ^ . 

. attitude^ tbward education . - . 

. attitudes tawaxd^pecif ic aspects of program attended_ 

. attitudes toward nursing profession and nurses role(s) 

. attitudes toward^self , ' 

'3) Types or proffeis^of-itudent success, including 

. academic achievement within program ' 

' . self^iierceptions related- to success 

. intellectual /growth, entry to graduation 1 

; nT-nt»resR toward Personal and/or professional goals 



ERIC ' - 



ERIC 



1.0 



25 
9 



11 



OS ii 



45 Types or processes of 'sssicnaJ success, including 

• persistence ixt *:= trV. p<ofasF~ on 

• pd'st-gradtiats p^wL-jSk:- 

. professional ^.cv3:ricems=rr 

• development cf -r.erw prr.:f essioti^ P^^^P®?^^"'"^ 

• development of new nurr3±ng rcle def initior;5 

i development/n:a±rrrerar.-= of professional irirerestis and ac: - : :ies 

5) Student^ perceptions of -?-e ±£vc^~tional environmer.r ySzZl 

The qiiaiitita=,'^ ^-3:^ set pertaining tc lac-^:.!;- is note 
limited in scope, but it szi V- -ics ri^ny variable^^ abc-^t en 

dual respondent- Analyses rT _-£S=e data ^11 be orga=:izec aro 
exploration of the fbllbwir, -rs^ relatl^:; to the -^sc^r- :cr. 
sample: 

1) General characteristirr^. : - t±x.z 

. educational r "trkg: . =^ 

. prbfessidrial ^r^'V^ 

. some dempgra' 

- personality t' 

—inai attrihut--:, 



. i> . 



attitudes tc " ' : i"^- ar 

attitudes to-sTc - _^..ec-- tif o^. 'o^t^t.. 

it:t±tudes tovr-.t-c ' • ^ fesii-^-:r. and -=ses' -tc . 

/srfirtudes tovarc - 

?r3rre:.is . interactlc -ua^nts, :;^cult , zznninis irar -^rs ^r: 

tr orrinrassidnals 

.4') .--ult . -rceptibns ' ^ne eci^ationaj r-Tiro^^-eii: (NSEI5 

me quantita-. set pertainin^ tto 'progr—'' is 

rt:r: ;:aily quite small^ enia "^^tixn^ in its entirety fro^ the six responses 
to thre Frogra- Survey (see n-nsr " - ii) - However, 2- ch student and 

^ty data sets are ccmplen^ ^nd processed^ ^uarrtr^rative data in 
^ r^ate forS (i.e., summed -iri. c r averaged bj pr-cirr:jm) S--.OTne available 
iDx analysis as ^'prbgram" varijibi--. in the fizaT . .iges cf analysis, 
rrven this will be the largest md- most comprehdnsrLvTr of the three data 
^ti^ including aggregate dat^ retr aining to stueeenrn and faculty from 
I the six participating 7 : ^ rams as well 35 ^ "original" vari- 
^le.^ pertairi.lg to size, io^:::>- , history, accr- :^tibn status, etc; 
.nalysis of these data wil^pr'Dvide che quarx'^r-zive basis for 
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address ^^g the si^^ry research cpue-'-ic- - :i the— ^vSSr.. (1) tc charac- 
terize t.r:e cdmpdnents : .nd ±tie burrsc-^^ c-f second zzaiz nursing adticsticm, 
and (2) to fdnnulaze a diBS^riptive arr.t :^^yz±c r-cjf^ of this rurricular 
iiiiiovatiion. 

Within irh coiifir^s cf f riT? ; brief zi^-^-^^y we do -ot attempt 
to deLiz;i-:i5te each an?; . ' ic proc--dure . In general, .:r:ii-everi oirr design 
for tr:- z^lysis of c: -^.ritati-^e di^ra Incorporates fdlldvi:. - steps: 

1) Fr- 'rzJth^atuit^,j:z srudeEr 'ilata, rhese s::eps arr- indicate i. 

Obtain cLssz:, d^cri^ ^.ve, s** r.tistica_ sunnnarv eiicr. 

s^-^e i£ terns iZl ±n/:.lvidual c=ntitativ- ■rari_-,:les 

. Review t±::ii ourcoic- s cz '.n ; p: r. lim: nar— analyses -r. rems 
of r-:--- .3—±i ciuc'^rS'^; -^e crcs: t^i^' -lations ^rji 
Ses^ - zz ^^^oc±z::Zlzr-- M ^:r:l^:re re^atidnshir- "cng 
var-:^^:; ■ zhs - 

. Underta cc~re^t- .-1 a-alysas f or further sp^rifi- 

. canton cr re .-r^- -r.ships aincr:g ordinal and interr^ data. 

. Refine and nduc-:^ -ne ..^er of variabZ-es by the cr^:uL ^cn 
of scale-, zzziii-^ ^r-, orr f:=ctrrs. 

2) For student csta oni:' v-. ui—Gr'tak^ tbeso- a dirir'--?;^-': steps. 

. Defi^ and I'^z r^-;e_ variable?: for — * -aas^-irer r: 
change ot^'x rirf" ar^ pbi^onti^^liy ^v- -^able anr: 
-eievanr: "nrrt the of the re :;arch qu e-^' 

Cbtain ind-^vi; ^:l cfttr^e sr -res anti>^Dr crbss-ser: 
'""^^ change rie^s^^zr^- as s^tnTcrr^ ite, aiB tt.st for le~ _ ' : 

s::.ghificxrr:r^ ^ch ras^ ^ 

Using ail orr;:;=^. frcr; :prz;vii0us^ analy^^-;? ^as veil a^ 

conceptr ari^dn^ frra qucli^rative ^^lyses) creare or f- 
cr liidre cctnrr^tre ''©eastt^es'^ of personal, academic ar. 
r:rdfes^:Lonal ^.--ce'iss suc±i rhat a^ srudents can be 
scored' aarnrvTing; t ^ >^ or riore ^veis of success. 

Cre~^re sub--3mpl^s of "h .gh'" and "lew"" r-^cess: explore t'nir 
statistical - 1-^: ri-:-^^fp c the ^rr-^s me^ures to 
other arprdprrii'tL var -^le^s in rhe ^alytiL:: data set. 

3) Using only the completed pra^r n d^nr set, the final qc^nr iitative 

analyses are designed to ass^^^ t> - z^:ee tc which the six progra:-5 
differ from or are similar t:r c .>p;.::^r wrLm reference to the 
following: 

Characteristics of ±r i^^- s 
. Characteristics of facu^-A and administrators 
. Levels of success ari/or r—ii'j emenr 
. Measures of change over .^lizc 

Other -^ergent variabilis 3ropr:late 



A^. St atistical procedares 

in this sectidtii we present in roughly chrdholbgical order 

rhe-rasic statistical ianipuiations of data forecast for the guantitativev 

_ _ _ - - - -- - * 

a2is_ysis of the NSSP data sets. Although in this particular study, the 

iat^^ stages of the analysis deal comparatively with "program data" (in, 

ordsT to characterize the Second Step as a new model of baccalaureate^ 

g education), cur' issumptibn is that the more immediate interest of 
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r/Dsi readers centers around the use of statistical methods in sihgle- 
csmpus evaluations. The . emphasis , therefore, is npon the-quantitative 
analf-sis of data from students and faculty, ■ r 

a. Descriptive statistics: frequencies, percentages and averages 
As soon as the first batch of quantitative data is pro- 
cessed and ready for analysis (as, for example, when Entry Questionnaires 
are keypunched for.Cisss 4), the analyst typically orders a set of descrip- 
tive statistics pertaining to that particular sample. These numbers 
do exactly what the term implies: they describe the -sample in terms of 
whatever variables are r'ncluded in that particular instrument. For a 
nominal vari3b5.= such^as "marital status »" we merely learn how many and 
what percent of the sample said they were single, maffied, divcmed, etc. 
Tor an interval of ratio variable such as "number of months work experience 
some type of an "average" response is useful in describing the sample as a 
whole; 

For a reasonably large sample, an arithmetic mean and 
standard deviation usually serve this descriptive purpose, but you can also 
look fo^ the median and modal re£?5bnseS. The mediaii is often preferable 
in interval level data, especially if a few extreme cases occur which laay 
throw the arithmetic Sean off from the central tendency of the total groups 
since the mean is greatly influenced by extreme cases. One also likes to 
know the shape of the curve made by the frequencies of responses. Is it 
a nbrihal bell-shaped ca^ve, or is it asymmetrical with some cases piling 
up on one side or the other? Or is it bimodal having-two (or more) high 
points? Knowing the shape of the distribution curve is fundamental for 
the use of other statistical Methods, since che most efficient methods 
make specific assumptions about 5.he nature of the distribution. It is 
coiSon to assume a normal bell-Shaped curve, but this may not be the 
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case with your et^irical data; 

b. Cross tabulations and measures of association 

Descriptive statistics are often more interesting and 
informative vheu presented in a comparative format. In the !5SS?, for 
eacample^ we are interested in learning about "all entrants^" but we are 
^qtia-ny- inter^te^^ of-.-thc^ six partliii:- 

patlng prograSi separately. ~ne following hypci±-cical table, for insr^ru 
indicates that "most" (642) eirtering students a=2nd on a part-time basi- 
but that this is not at all zrne for Program "C. 



S-:udent E nrollment -Sratus; by' Program 





Particip 


a ting 


Program 




All 


A 


B 


C 


D 




F 


Programs 




50% 


70% 


20% 


35%- 


10% 


36% 


70% 


50% 


39% 


80% 


65% 


90% 


64% 


40G 


80 


350 


250 


200 


275 


1,555 



Student 
Enrollicent Status 

Full-time 
Part-time 

N = 

• 7>ie above table is calied a cross tabulation or contin- 

gency table, and is nothing more than the doiht frequency distributions 
between cases on two variables: prdgrain ID and student enrollment status 
eioss. tabulations are the most common fo^Sac for presenting and analyzing 
relationships in social* science research- 

- Sometimes an association betr-jeeri variables can be noted 
simply by viewing ("eyebaliing") the percentage distributions, but these 
distributions caS also be analyzed in order to detemlne whether or not 
the Variables are, statistically independent. Perhaps the most cdrnmpn - 
statistical test, and one of the .relatively few that are appropriate for 
nominal variables, is that of chi square. This statistic requires care- 
ful interpretation; it indicates only the probability of an assbciatisn 
having occurred by chance. Standing alone, it indicates neither the 
strength of the association nor the correlation betweeii the two variables 

A number of "measures of association" can serve to 
further summarize and clarify the information contained in cross tab;^a- 
tions; three of these are l^tnbda, the uncertainty, coefficient, and gannaa; 
ail discussed in the SPSS Manual. Such measures cati be used to describe 
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..a variable tend to predict or vary 



ly useful for ordinal dats: ; ' iz 



relationship and '2) its cirerrlor. (i.e.^ 



the d egree to whicl: ^he values 
with the values on i^ie drher. 

indicates (V -he .z=g::h oz ' 

vhether the — iab.e^ are -^slr or negatively associated v^rn -ne 

another)* - 7 .^-~=,is<r?s 1^^ --i^^yrxiughiy discussed in ■s*=:ve:rol ^e' :-*-^nces; 

(See for ie ^E. llsr . - :ess_er and Costner, 1970.) 

Crc3r - " att-l-^^Sy in cohjuhciibn "ith a varie r^- zz 

statistical ^cedCTe- -^-"rier clarify the reli^rionships &^'rv^. 

two (or ^ore .rlabl-s. an- :r::rt otay as a ^ea-s of describing 



segments of - rbtal s2 rn:- 
as a way of ej-^.;^^:=in±ni re la' 
dat<i throughc-mz rhe e:—" /s: 



beginning of tne analysis?^ but .^!sc 
"Detween different elements ±n ris 



cient, wnicn 



22na: 



that the var f — ' es c 
Like the measures o^ 
indicate both tbie st 
variables. 

interval le^?.^ of in- 
etc.) are cl-*l y ir. 
detail in t: *'lari 
scattergrar is I 

the horizor- i i^is 
scattergrar J n^r^e : 

A fairly rea :^ : 
page. 



- j;r:r^. ..--.yields a single number,, called a cdicni- 
-he rjL^ionship between two variables, pro--ied 

a- ^eybnd the ordinal level of measurement. 
d;.-.:-iaT -1 discussed in the previous section, hey 
e-ng^r: rhe direction of relationships betve-n 

- "-^cn_r. : of the NSSP data exist "below" th i 

- .irsr.er.-, seme (such as age at entry, test ^rres^ 
.^£r\-al ard/ar ratio level measures. To see e 
—ship c:f rwo interval level variables, one ^ -5^s a 
£3 a graph cf data points, where one variable ^fines 

:nd che other the vertical axis. Lbdkirig at -.-e 
-_rst step in the analysis of two interval vari^-biesi 
:ut hypothetical illustration appears on the fr! lowing 
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Age of 

Students --5 - 



5 IC : 20 25 3C 
Ca^mel 2St Score 



35 



relationship. ^ 
"swarm" rougfczr r": 
few ca?es tlia 
regression ar _ys" 
data, and Per - or:" 
"Mcdness of < 



tiie "shape"^ 



viewing a scacre r:grx-m, one can see the shape of the 
primarily linear c:zfvilihear or random? Is the, 
52^e thiclmess thr j:uc:hbut the scale? Are there a 
c-t by themselves- The statistical techniques of 



vnich seek 

-roduct Doment. c 
V 

lie regression 
j.ta which can or 



:he "best" line or curve to the 
latibri (r) , uhich measures the 
make certain assumptions about 
be observec by looking at a 



STiattergram. 

cirectly wit 
have a larg^ 



Ccrrelation analynds is often used instead of working 
:rrss rabulatidns, esrrzr^iaiiy when one or both variables 
:31b er of categories, r.iaking the cross tabulations themselves 

>!_ 

nnwieidiy anc difficult to interpret. Two cdmmdn ccrrelation cosfficients 
for use with ordinal data are Spearriari's rho and Kendall's tau. 

A. - _ _ _ _ 

d. Creating scales and indices 

• these tv70 words are used interchangeably within the 

social science literature to refer to techniques of combinirg two or more 
measurements to form a single score which can then be computed for each 
case. On page 89, for fcstance, we call for a quantitative measure of 
"progress toward personal goals" arid of "progress toward professional 
goals."" Since many iridividual items bear upon these areas while no 
single item measures it directly, one solution is to create a composite 
measure which makes use of the relevarit data available in order to assess 
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such progress. 

The f irsr =rep in creating a scale is to make cer=ai=i 

that -he items theoreticaiiy f±i together so that the scale has nie=Lns; 

For esaajplei one qnesticsn an che Entry Questionnaire (see page ^sks 

^studests to- ra^tfe t^eir^'c liiujk^ka cfe in- six difxerent aspects" of ';TiaTS±=g 

: _ __ - _- - ^ _ t - 

Icndwledge and ability. Theoreticaiiy; the sunmed total of a respcn=ier-t s 

six sub-scores might well represent that srudent's self-evaluation = 
overall co^etence in the nursing field. The total score can rhen -^e 
used as a variable as well as each iters sccre. 

Attitudinal scales should fit together both tiieor--- 
cally s-^d .'statistically. Ansther question on the Entry Questicnns- r- 
(see page 31) asks students Their interest in various activities rs: --ted 
to nursing. Theoretically cme might argue that all eight items me_.s^re 
s55e coranon concept of professional activist. The simplest way trr con- 
firm or refute that argument is by correlation analysis. All V3^£ les 
included in a single scale should correlate with all the others - - - 
reasonably high ievel. Scales or indices are meaSs of summari ing 
quantitative data into concepts that a^e both theoretically cbhe ^nt ^rrd 
statistically • sound - 

e. Dealing with change 

One of our basic research aims is to discern rne Inrract 
of second Step programs on the students. Central to this was th2 infu- 
sion of a iongitudiSal sample as part of the overall design. Many cu-^S^ 
tions and whole tests are given to the same student at entry ana agair 
at graduation so that individual change can be computed and measured, 
individual change scores are computed by subtracting the value at tine 2 
f^pm the value at time 1. These change scopes become new variables in 
the data set and can be used as any other variable. For interval data 
such as OPI scales or NiJI test scores, a t-test determines the signifi- 
cance of the measured change. The Milcoxon matched pairs test is a 
similar statistical technique fo^ ordiSal variables (Siegel, 1956, 
pages 75-83) . 

These same techniques are also used to determine the 
significance of cross-sectional change (e.g., "all entrants" vs. "ail 
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gradtates") oi t5 c5Spare ^ic^js sub-sasples in terns bf cfiange bver 
tiae (e.g.. Higb achievers jff low achievers); 

f . Dealing with srz'r.-. -emerit and "success" ; 

la the r-rrrr- -^ges of -Tiie-; quantitative analysis of 

student data, utilizing "a -^ed data set and Dutccaes from all 
previous analyses, the NSS3- ^dgn takes on the problem of measuring 
"types and processes of -s=~s=:z snd professional success." We begin by 
assuming that success, ir--£ — theoretical concepts, is inherently 
multi-diiensional, thus, -h^t ir can be defined froi several different 
perspectives and therefor- nessured by Seans of several different kinds 
of data. 

The bas-ic scstisticai techniques used in this process 
are those associated wit'ri:: creating scales and iiidices. That is, we 
create a composite measuri vhich hangs together both theoretically and 
statistically. But rat? =r than aiding for one single measure, we assume 
from the beginning that =cre than one index will be found to satisfy both 
criteria. 

Regardless of substantive outcomes — i.e;, the precise 
definitions and indicators Which eventually serve to best represent these 
types and processes of success in second step nursing prografflS— the pro- 
cedural outcomes can be •outlined. 

The success measures themselves are defined as new 
ordinal variables. .Since each-is composed of a separate group of "old" 
variables on which student data have already been collected and processed, 
a program is devised to "score" each case in the student daui set. If 
three measures of success are constructed to represent three types of 
sm:ces3, every student is thereby assigned thre3 aew scores, each repre- 
senting that individual's level of achievenient according to the three new 
4 

measures .' - 
The last set of pre-planned statistical procedures 

(Although every quantitative analyst knows that others Will occur in the 

course of the actual analysis) is designed to examine ihe felationship 

of the various dimensions of success to other variables in the analytic 

data set(s). By creating student sub-samples composed of the highest 
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and ibvest scorers on each dlineiisidn,' the analyst gains access to a 
greater variety of expioratioas and insights tnan would be available by 
cbrreiation analysis alone; the basic strategy* then* is tc "describe" 
the resulting sub-samples as inf drmativeiy as possible— not only whd^hey 
arer Sut wha^ students in "a second step curricu- 

:ium. The intent of this final analytic phase is not so much to isolate 
"predictors". of success as it is to clarify our understanding of the 
educational processes which appear to enhauce or to Sinimize the^achieve- 
ment of those qxialities that combine to produce one or anbt.her Of our 



success "types." 



Tlie delineation of sub-samples, then* permits a new 
series of statistical procedures--from simple descriptive statistics 
through correlational analyses=^planned around this .explanatory focus, 
it also necessitates a fruitful synthesis of these quantitative methods 
with the outcomes of qualitative strategies, and a disciplined interpre- 
tation of the findings of each. 

C. Validity and Reliability 

According to one authority, "a measurement procedure is con- 
sidered valid to the extent to which its scores reflect true differences 
among individuals, groups' or situations in the characteristic which it 
seeks to measure ... (and) is reliable to the extent that independent 
applications of it yield consistent results." (Selluiz, 1976, page 197) 
These are important and legitimate concerns, and we strongly urge that 
the evaluator who is unfamiliar with the theoretical bases and the broad 
applicability of th^se concepts' take the time to become familiar with 
them.^ For the purposes of this manual, however, their treatment is 
tied rather specifically to their relevance in the NSS? research design. 
Since that design combines both qualitative and quantitative strategies, 
each of which takes a somewhat different approach to these troublesome 
issues, wo limit this discussion to defining the areas of concern rather 
than detailing procedures for addressing them. 

i; Observation and cbhceptual analysis 

in the qualitative analysis which relies upon the grounded 
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theory approach (Glaser and Straiiss, 1967; Becker^ 1958), statistical 
tests for validity and reliability play Tib significant role. The qualita- 
tive analyst working in this inode, via direct' observation and conceptual 
analysis, is not usually preoccupied witn establishing the absolute "tr^^^ 
of the aodel s/he constructs, but rather with establishing its credibility 
and usefulness in explaining a social phenomenon. Self-imposed rules 
governing the conduct of the analysis must provide some assurance that 
the inferences which are drawn from the evidence actualfy cdrrespdnd to 
an external and consistent reality. 

One useful guide is to "stay close to the data." To be worth 
their salt, findings -should" say "more" than the data from which they arise; 
but their relationship to that empllrical base must be clear, both in the 
mi^id of the analyst and to the audience s/he addresses* 

Second, and closely related, give evidence. The researcher 
works without the restrictions (and the benefits; of statistical proofs 
and assumptions of normal distributions. The significance of particular 
clusters of facts and the meanings assigned to those facts rests not updii 
a level of probability, but rather upon the perception and sudgment of 
the researcher. This freedom is the essence and the strength of qualita- 
tive analysis; factors may be "important" and highly influential without 
being "lypical," and explaining the divergence is often as revealing as 
accounting ?or a central ter^lency. A rich qualitative data base lends 
%tseif well to uncovering the unexpected and probing the underlying mean- 
ings behind conventional wisdom. At the same tim^i, it imposes the burden 
of proof directly upon the researcher who cannot simply "compute" a level 
of significance, but who must build a convincing case for each^ference 
drawn from the evidence -^t hand. 

:hird, be ske-tical of your own findings. Much of the 
strategy of grounded theory research is built around the process of vali- 
dating one*s ideas and concepts with reference to new evidence, new experi- 
ence, new perceptions. The constant back-and-f orth exchange between 
"questioning" and "answering" foSns a strong support for both the consist- 
ency of the obse^ations and the conceptual validity of the elements that 
survive. 

Finally, perhaps the best "proof" is to be found in the 



general coherence of tne findings thenselves; S5 the concepts hang together 
and Tuake sense? ' Can you -explicate a Icind of logical consistency from one . 
to the next? Do they "fit-* with everything, you kiidw about (in thi^ case) 
second step nursing^-prbgrans? ' , - . 

Saving said all that^ we. must concede that "pure" grounded 
theory plays only a small 'part in the NSSP methodology. Axthougl^irect 
observation and document analysis are techniaues that contribute importantly 
to both the evidence we accumulate and the outcomes ve hope to achieve, the 
bulk of our data Is derived from the rather extensive battery of instru- 
ments described in Chavter .III. ^ 

2. Dat a-collecti-^n ihstrunients 

— '" — * ' ~ ^ 

; To establish che validity :ana reliability of either a coEpiete- 

instrument or c single item requires ;repeated usage and/or a relatively 
ia^ge sample of respondents. One reason program evsrluators lean toward 
the use of standardized injtruients is because, with a reputable published ^ 
instrument, that work has in all probability been done ^and is" cited in the 
accompanying manuals for reference.- Mcst single program evaluations have 
neither sufficient time nor sufficient tample size to include a thorough 
statistics'' ;- -:ssTnent of their data collection tool?- 

V',.: r;sSP research effort inhabits a sort of middle ground 
in this z--^- : ^veral key data-collection tools are published instruments 
with a backlo;.- .sage and literature which selves to establish an accept- 
able degree-.bf validity and reliability.^ Our profect-de^igned instruments, 
however, are in va^^ing stages of "maturity,", and deserve seme further 

' - 7 
comment. 

a. interview guides 

Three are interview guides: one for studsnt group dis- 
cussions, one for individual faculty inembers and one for administrators. 
Although interviewing is often used as a method of collecting information 
from individuals whose responses will then serve to represent the popu- 
lation from which the interview sample is drawn, che NSSP inr-rviews _ 
serve a quite different purpose. Student discussants, although randomly 
selected, do tiOt provide "individual" data; some may respond to one question 
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and soEe to anorher, and transcripts of the discissions 'illl riot iceritify , 
^the spea^]^ As for faculty interviews; non-raridom sampling combined vit'a 
'very sioall Tiuibers of ^ii^riderits preclude tile use of these data as repfe- 
SSEtati^e. Aiid adSriistratcrrSi- €vct tho^^ the sua total 

of department heads in bur six-program sanipie, do not furnish enough 
responses to permit quantitative handling beyond the level _o?F Simple 

description. > . . 

"""^ The primary function of these tools, then, is to provide 
a rich vein of data for qualitative analysis; thus, although variables 
■pertaining to "program** (rather than to persons) may emerge from such 
analysis, the iristrumeats are not designed to "measure" hat rather to 
ierierate insights which help to clarify and explaii the phenomenon under 
study, under such circumstances, instrument reliability in the sense of 
consistent measureierit from one application to the next has little mean- 
ing or import. 

• The validity of the raw data^ on the other hand, is a 
pfime concern and is aided by two builf^in safeguards: (1) the p^^ence 
of che researcher whose task it is to make certain thi^n the questions 
are understood, that :-he responses are relevant, and that the respondent (s) 
are, insofar as it is possible to judge, providing information that 
reflects their "true" opinions and reactions; and (2) the use of verbatim 
taped transcripts of thes^ discussion for purposes of analysis, alleviating 
any concerns about the loss of certain crucial aspects- of a respbnse due 
to the iricoipleteness or subjectivity of the interviewers' notes. 

b. Questionnaires . ^ 

A measurement- procedure, as defined by Selltiz (1976), 
consists^of a technique for collecting data £lu£ a set of jules for using 
these data. In the NSSP project-designed questionnaires', specific items 
represent the basic techniques, arid the codebooks cbutain the rules 
governing usage. Each variable entered intb each data set is, in that. . 
sense, a measurement prbcedure and is therefore 5pen to question cbncem- 
ing its validity, or the extent to which it provides a "true" measure of 
.the characteristic, and its reliability br the extent to which it produces 
consistent results. >. '' ' 

In some instances, qualitative analysis produces 
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quantitative variables^ as whiBii codes are derived from bperi-erid questibh- 
riaire items for inclusion in a quantitative data set. We inay assume that 
whatever the respondent writes is "true" or valid, in that respondents 
are free to answer in any way th^ choose. But in the. process of quanti- 
fication ^ words arid phrases are transformed into a set of coding categories 

How subcessfully that process is carried but invariably influences the 

----- 8 - • - "9 

construct validity of the cbded item. 

Another important concern is, bf course, inter-coder 
reliability. Since the way in v/hich each case is coded depends: not only 
upon what the respondent wrote or said, bat also upon how the coder iirter- 
prets arid classifies that response, a major threat tb the reliability of 
such data rests with the differences in perceptidri amongst those who do 
the coding. There are several ways of coping with this problem: 

1) The same person can do all the coding, makirig careful and complete 
notes as to how each category is being interpreted in the process. 

2) Two or' more personi can code all qualitative materials independently, 
and be required to resblve discrepancies by discussion and concensus. 

'30 — Two or Sore persons^can "divide thrqua lXtat ive coding by^ random 

assigniiient, each working with a certaiiT^pSnxbn^ materials 
' tb be coded. In this method an additional variable becomes "coder"; 
' each coder "signs" his or her work^ so that reliability ratings 
between coders can be statistically obtained. 

None "of these methbds are guaranteed to eliminate the 
problem, but they can reduce it considerably. When statistical tests 
still indicate low reliability Coefficients for certain qualitatively 
coded variables in spite-of such precautibris, it may be necessary either 
to start from scratch arid derive nev coding categories or to define the 

c 

existing classification scheme more explicitly. In either case, however, 
being aware of the problem is half the battle. 

The ;iarge majority of the variables in the student data 
set, however, are not derived sfrom qualitative data, but are taken 
directly, from pre-coded questionnaire items. these cases, the rules 

governing usage are largely incorporated into the data collecting tool 
itself. Inter-coaef reliability, then, is in a sense absorbed into the: 
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iore general defiriitiori of item reiiabiiity, since respondents essantially 
"'code" theiiiselN^es. 

:~ All Of the NSSP project-cesighed instruments are, as of 
this writing, iii current use foi the first time as completed data-collection 
tools, although they were developed from a similar set of tools employed in 
the earlier Demonstration Study. Specific items with apparent problems in 
validity and reliability were intentionally omitted from the NSSP instru- 
ments. Nevertheless, our various questionnaires contain several hundred 
untested items. 

Faced with the sheer number of measures incorporated 
-into the NSSP data sets, it is both unnecessary and unrealistic to set 
about establishing the construct validity of each and every item. Those 
efforts a^e best reserved for tne more significant and central concepts, 
such as, for iiistance, the dimensions of success. More important for the 
potential user of these instruments in their current form, however, is 
the fact that the sample structure in the current study is sufficient in 
size and design to permit the establishment of levels of reliability by 
means of accepted statistical procedures.^ These analyses are to be under- 
taken in the second and third years of the NSSP research, and results will 
^-incl4id^d_in_ther:lini l report to be released_in 1981. 

D. Synthesis and IhterT>retatioh 

■ During the final phase of the analysis, the major task is one of 
achieving a productive and workable synthesis between oui complementary 
and parallel research strategies, quaiitStive and quantitative, such that 
we arrive at not two but one coherent, theoretically sound and empirically 
demonstrable explanation of. the second step phenomenon. _ 

The qualitative segment befxns with a virtual universe of col- 
lected observations of se-cond step nursing prograi? in action-=verbal com- 
mentary in the form of . questionnaire Responses, interviews, discussions, 
documents, etc. -and distills therefrom a "model" of this fast-growing 
form of baciiaur^ate preparation. The model is ah abstract but valid 
description of the phenomenon itself; it is made up of explanatory con- 
cepts derived'^from a consideration of all the available evidence collected 
and analyzed- concepts which "fit together" to opiate a "whole", picture 
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of a dynamic educational process: The model is grounded in empirical 
evidence, but rather than merely reflecting and summarizing that evidence, 
it creates a theoretical framewcrk capable of accommodating and recounting 
for aii the isolated facts and observations whi^h have been collected ana 
considered. 

Th4 quantitative segment begins with three data sets, all of 
which are staggeringly comprehensive. The data pertain to students, to 
faculty/administrators and to program; taken together, they contain many 
hundreds of discrete variables, each representing a single retrievable 
bit of coded information choui the students, the faculty members or the 
programs in the sample. Analysis of the student data set provides a 
very complete set of descriptors of the student population; the faculty/ 
administrator data set serves to describe those populations, albeit in 
somewhat less detail; and the program da^ta set includes aggregate data 
pertaining to all populations as well as additional descriptors of the 
program as an ofganizatibnal entity. The analysis of each data set is 
undertaken separately and produces an objective and accurate description 
of each sample • A preliminary intent is to dis-cern "typical" character- 
istics, attitudes and behaviors. More complex analyses indicate signif- 
icant relationships among variables; reveal unifying factors ^ concepts 
and dimension s which^ iunction to connect and add meaning to isolated 
findings; and provide statistical rationales for inferences about the 
larger population of second step students, faculties and programs. 

Since that phase of the analysis which concerns itself with 
synthesis arid interpretation is still in the future as of this writing, 
we include no description of the step~by-step process by which this goal 
will be accomplished. We have, however, given serious thought to the 



importarice of achieving such a synthesis, and have evolved four general 
giiidelines for steering ourselves in that direction. 

First, simply allow enough time for bririgirig the two sets of 
findings together- Both parallel atfalyses should be brought to a stage 
5f near completion as early in the final yea^ ai possible. Preliminary 

findings arid emerging concepts fro^ each aspect, theri, are permitted 

. _ _ _ _ _. — _ — 

encragh '^f ermentation" time to develop a cohesive sense of wholeness prxor 

to the statement of final cdnclusidris. 
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Second, don't work in a Tr^~uin. Especially in the constantly 
changing field of nursing educaticsi, developinents iti the world outside 
the research office surely need tc "be taken into account in interpreting 
findings and refining ideas of the: processes that occur in conteinpbrary ; 
educational practice • Poiiticai events of the day, for instance, can be 
counted on to influence the actioas and attitudes of students, faculties 
and organizations. Equally iiiipdrtant, maintain contact and current know- 
ledge of other research findings; these may stimulate new perspectives on 
the data at hand, and may serve the broader research function of "building" 
upon previously established frameworks, thus enhancing the usefulness of 
both efforts. 

Third, summarize constantly. Especially in a design incorpor- 
ating large bodies of information arising from relatively "separate" 
sources of data, it is i^ortaht for all members of the research team to 
be able to maintain contact with what "the other side" is learning. By 
producing working drafts and data summaries throughout the conduct of the 
study, the goal of synthesis can be begun well ahead of the final crush. 

Finally, arid closely lelated^ coinnunicate. The working drafts 
arid data summaries are only a partial approach. During the final analytic 
phase, substantive seminars can be scheduled, for the expressed purpose of 
melding the two sets of findings, each focused upon specific areas of 
research interest. Both qualitative and quantitative findings _pertaiiiing__ 
to those areas can be presente^/ discussed, arid the linkages forged and 
articulated. 
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Notes 



. Readers seeking a more complete and general, treatment of this broad 
topic have a wide choice of such texts available. See, for example, 
Selltiz et al. (1976) and/or Siegel (1955>- 

k 

. For an example of a single variable which represents a more complex 
idea, consider w hat w e call "Impulse Expression, Time 1" or "IE 1." 
This variable has nothing to do with anyone's personal Judgment of 
that person's impulsivity; it is a scale score from a standardized 
personality inventory administered to students at time bf^enty. 

Coded categories rtm from 0 (very low) through 59; (very high). 

Standing alone, the rev score tells us very little; but in conjunc- 
tion with other variables, or with reference to the scores of other 
student s^les, IE 1 can furnish a valuable perspective on Second 
Step entrants that w-ould be difficult to obtain by any other means. 

. It might be tnentioned that the procedures we outline here are merely 
the broad outlines of statistical icaiing procedures. In instrument 
construction^ where the object is to produce a valid and reliable 
scale for future use. in attitude measurement, the process is much 
more painstaking. Such scaling often begins with factor analyzing 
a huge pool of separate items, and continues through to thoroughly 
testing the finished scale for test-retest reliability: For a good ^ 
discussidii of scaling and inducing, the reader is referred to Selltiz 
,.et al. (1976), pages 400-431. 

. In carrying out these scoring procedures, cases with missing data pose 
problems. Our procedure is to score only those cases with good data 

on more than half of the component variables, and to consider the 

remaining cases to be "missing data" with reference to that particular 
measure. 



— ^ ^n^ ^Y^t^^^^r^^-^t^ M ethods in Social 

Relations by Selltiz et al., 1976. Now in its third edition, _this 
Readable text devotes some forty pages to ^'General Problems of Measure- 
ment" ^itT^en irom a positiyist orientation. Even this lucid exposi- 
tion of the validity-reliaMlity continuum does not treat the tests 

^ themselves in a^ statistical detail , but further references are 
numerdUs and current, 

. The DPI i NLN Achievement Tests, the CFI, ^and the NSEI all fit this 
definition. 

The EADS (see pages 29-30) is not considered problematic in these 
respects as it is not administered to "respondents" but filled out 
by research associates with the resulting data entered into the computer 
only after careful editing for accuracy by the data analyst. 



(Continued to next page.) 



Notes for Chapter V Continued: 



8- Validtty is ah umbrelia term encompassing many variations arid "types, 
each of whiafi Say be established by differing procedures. The defini- 
tive work on construct validity was written in the mid-Fifties . 

(Cronbach and Meehl, 19555. The term implies that what the researcher 
is attempting to measure is an idea (thus, a i^ental construct) about 
an individual—a characteristic or trait that the individual possesses 
or does not possess—rather than merely a single behavior. Most global 
codini is done at this level of abstraction. In testing for construct^ 
validity, then, we ask ourselves how we would expect persons classifiea 
in a particular way to behave or '"scbre" on other measures that are 
theoretically related to the variable we have created (i.e., the 
"construct"). 

9. Cronbach 's Alpha or Split-half coefficients can be computed for any 
scales oi composite indices that are crested to test their internal 
consistency. 
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CHAPTER Vi 



THE FINAL REPORT 

izna Txae this Iiypbthetical situation: the data are in, rhe 
analyses are ^.taplete and you have a perfectly lucid unr^et standing - 
what it all neans. The hard part is over, right? Wrong! Now you 
ati entirely new and different problem: explaining it to somebody 

Reporting the dUtcdtnes of a research effort can take any « 
wide variety of forms, ranging from a one-page rairaedgraphed hand^c^^ 
a best seller. But since educational research is often externally funded, 
probably the most prevalent form, at least the first time around, is that 
of the Final Report — a sometimes unwieldy document submitted to the 
funding agency. 

li there is a folklore of research, it might well reflect an 
uneasy feeling shared by many writers of these documents that the reports 
are more often filed than actually read and pondered.. Nonetheless, tSey 
must be wr:^^ein. if well done, not only do they furnish a comprehensive 
record of rne research has accomplished but they also serve as a 

rich quarry j:f Infcriaticn from which smaller, more digestible and pub- 
lishable arricles can be carved and polished. 



A; PianhiJig 

The single most important thing to say about planniitg is simply - 
to do It. Lack of planning can resnlt in, among other things, a financial 
crisis; it is usually persrissabie to delay the cdmpletion of the report ^ 
but funding for the extension must come from the budget for the final year 
which may well be depleted at the end of the normal funding period. 

The first step in planning the work is to obtain the proper 
guidelines—a step whicti can be taken <iuite early in the final year of 
the research. Like most extemaSy funded program evaluations ^ the^NSSP 
b«es its existence to federal support; and like most very large organiza- 
^OTS, governmental agencies tend to be slow in responding to individual 
requests. Each agetidy has its own specific forms and zreporting require- 
ments , and these may ch^ge in some ways from one year to the next. It's 



fairly safe to assume^ however^ that they won't change drastically. If 
current guideliries are not available early in the year , a copy of those 
issued the previous year can be equally helpful. 

A review of the form in which the report is to be f ilec ibles 
iiiuch of the work to be assigned in whole sections. Each ?ersbh vrhc con- 
tributes to the final product knows well in advance the ^enerai content 
and purpose of his or her own section and is accountable for producing 
not merely "findings J* but a presen tation of findings that will be an 
appropriate segment cf the document to be constructed. Thus, activities 
that necessarily precede the actual writing are known and can be incor- 
porated into that staff member's normal workload, rather than coming as 
an "extra" task to be undertaken durin? the final hectic weeks of the 
project. 

Because the report iust not only be "written," buc also typed, 
edited, corrected and possibly re-typed, length becomes an important con- 
sideration- Any research report car. be planned in advance to cover a 
fairly specific number of pages. A writer aiming for a twenty-page report 
simply includes more detail than the writer who is asked to describe the 
same study in tv70 pages. After the g^deiines and forms are in hand and 
the assignments accepted, each contrioutor . is able to forecast the approx-- 
imate length of his or her section, including visual presentation of sup- 
porting data (tables, graphs, appendices, etc.) as well as text. 

- The flnal strepST-^then^r are~se^:ting-the-d^a<^ 

the "product." As wirh earlier phases of the project, the best tactic is 
to work backwards fron the official due date set by the funding agency. 
In doing so, refer to a copy of your academic . calendar that tells you 
which days will be essentially non-productive, (such as weekends ^ holi- 
days and other "prior -ommitients" that will affect the completion of the 
report. With these restrictions in mind, ask yourself the following 
questions, and answer them realistically: 

1) When should the report be postmarked? (Do you need to allow two days 
for the campus mail service to function?) 

2) How many people have to "okay" it before it can go off campus? (Will 
they be in their offices that week? Will they sign it without reading 
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it? mil they require reading time and perhaps insist oh changes?) 

3) How many copies db >-5u heed? (Will ir be going to f duplicating 
services if s5, how much lead time do they require? Will tfcey collate 
and hind or staple? )- 

4) Afier final typing, who proofs the finished product for details and 
typos? ■ (How long will that, and making the cbrrectibris, take?) 

5) Who takes charge of deciding ail the questions bf format and style 
with regard to fbbtrotes, references, layout, table bf contents, 
appendices, etc.? 

6) Who will do the final typing? (How long will that take? Is that 
person's schedule "cleared" from other time-consuming duties for 
that period? H^ve you allowed extra time for typing tables, drawing 
graphs i etc.? 5 

7) Before final typing, who will assemble the various sections ar>d edit 
for substance: ' accuracy, consistency, literacy and flow? (How long 
will that take? How much ttie will be required for re-write?) 

8) What shape should the "co^itributions" be in before they go to the 
"substantive" editor? (Ar-. all the drafts typed with room for cor- 
rections, re-wording, etc.?) 

' After you have 'answered all these questions conservatively, ybu 
may be as much as several weeks "back" into the calendar depending, of 
55urse, on. the total number of pages yon harve prdaected. Pinpoint the 
date and plan to have everyone's well-considered choughts oh paper by 
that time. 

B. Writing 

Getting those thbughts on paper represents for sbme researchers 
the most satisfying part of the research process^a chance to present the 
results of arduous investigation to a waiting world, tor others, however, 
it's a traumatic time, filled with crumpled notes, half-written paragraphs, 
gudden doubts ^about the significance of what you have to say and how best 
to say it and (mit^theringiy) who cares? Without any hard evidence bn 
the subject, our gu^s^s that the latter outnumber the former by about 
ten to onci 
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As with atly writing task, the most important guide is to .have 
a clear mental picture of your intended audience. Write "to" a reader 
rather than into some ill-defined void. Jiist as in conversation, what 
you say arid how it is received will depend in large part upon who is 
listening—not only what they want to find out, but how much they already 
know about your subject arid, not incidentally^ how much interest they have 
in it. 

in the case of a final report to a funding agericy, all those 
concerns are relatively easir- -nswered- You can assume that your reader- 
is knowledgeable; if your report concerns the evaluation of a nursing 
curriculum, reader (s) in Washington or elsewhere may have degrees both 
in nursing and in educational research and will probably have read dozens 
of similar reports. Nursing research terminology will be understood ; it 
can be used without needless explanations; dti the other hand, it must be 
used accurately. You can also assume that they have read for have access 
to) your project's prior reports arid earlier findings; these can be para- 
phrased arid cited. ' Firially^ you can assume that their interest in your 
project is basically "professional." Reading y^.^r report is one of their 
professional responsibilities, riot something they have picked up becattse 
it looked iriterestxrig. They will probably appreciate conciseness and 
clarity more than poetic prose. 

As for what they are most interested in learning from your 

report i the best clues ar e contained in the " suggested format, " ^^'s^^ 

true that many other formats are equally acceptable, but writing and re- 
writing time cari be considerably redu-.ed by attending to those clues 
before you begin. A sample copy of the suggestioris from one federal 
agency appears on the foilowiSg page. , It must be stressed that such 
guidelines differ iri mariy important ways from one organization to another; 
but viewing' this one as a concrete example may be iristructive. 

Only two short lines— D and E~refer in somewhat cursory fashion 
to everything that has been learned in the course of the project. In the 
NSSP final report, were we follbwirig this particular outline, those two 
sections, covering both methodology and findings, could account for well 
over a hundred pages of text and tables. But althougE they represent the 
bulk of the report from the researcher's perspective, their importance to 
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Include the fbllbwirig identifying inf ortnation in the heading. 

1. Grant ntimber indicated on "notice of Grant Award." 

2. Title of the project; 

3. Name of grantee institution; 

4; Name of the project director. (If there has been a chaSge of - 
project directors, incluae names and dates for each person.) 

5. Total number of years for x*ich the project was^ approved. 

6. Time period covered by the Final R^&rt. 

The outline below indicates the kinds of in'^j^at ion which should be included 
in the Final Report. Review of these^iepoi^ is assisted materially when 
statements are arranged under a unifc^>n£Tem of captions. Alternate 
arrangements can be followed if moi^^lt$61v^ to the project being reported.- 

A. Problem or situation witl^^^^ the project dealt. 

B. Anticipated outcomes pi^^^ initiation of the project. 

C. Changes in initiall^i^^^ved plan- and reasons for them. 

D. Outcomes of the Eroj^c^^d how determined. 

E. Factors that inflxf^^lS these outcomes. 

Fr--^e^criptioTrs^^^^i^ project on" tlie niirs^ng "eHi^ 



G. Brief siimmary of what this project has meant to the nursing program(s) 
involved. Objective and subjective evidence could be included. 

H. Plans for continuing the activities related *;o the project (if 
appropriate) or plans for implementing the project findings. _^ 

I. En^olSneSt in the nursing program. (If applicant is a school of 
nursing.) 

At the start of the project period: 
At the end of the project period: 

PLEASE SUBffi-T^E-ORIGINAL AND ONE COPY ONLY 
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the iiOTediate^audlence need hot be overestimated; 

'Equally important ^ from the perspective of the funding agency; 

are the answers to another set of questions: What was the purpose of the 
project in the first place? What did you set out to accomplish? Did you 
change your mind mid-stream, and if so, why? Did you manage to do what 
you said you would? What difference did it make? What impact has your 
work had on your bwii program^ yduir institution and/or the nursing profes- 
sion? Underlying all these questions is a rather basic query- that is 
near and dear to the heart of the funding agency > Wer^ our dollars well- 
spent? And perhaps underlying that^ "What- evidence can we show to those 
whose fui^s we have expended (whether taxpayer or corporation)?" 

The final report itself should constitute a direct and accurate 
response to those queries, hopefully in the affirmative. Maintaining that 
perspective can assist the writer facing a deadline in two important ways» 
First, the actual findings themselves, especially their intracacies and 
subtleties, are probably more important to the writer than to this partic- 
ular audience. That does not imply that they need be slighted; rather, 
that their inclusion is primarily for the purpose of documenting what you 
have learned along with luppor ting data in sufficient detail for the writer's 
own use as a future reference. Second, the impact of the findings upon the 
world that lies outside the. research of f ice is probably more^mportant to 
the- audience than to the writer—at least at this particular tim6. The 
old adage about "not being able to see the forest for the trees" is usually 
pretty descriptive of a researcher struggling to compress two or three 
years of work into ten or fifteen pages of prose. Sometimes it's helpful 
to keep ah bpeh file during the course of the research into which you can 
drop notes, as they occur to you, about the effects of the project as a 
whole— any spin-off which has benefited your program, its students and 
faculty, the institution (s) , the co^unity, the professribh^ etc. 

. Keepihg those considerations firmiy in place, and attendihg at 
the same time to requirements for accuracy and reasbhable brevity, con- 
tributSig authors individually wbrk but their own solutions to the prxjb- 
lem of writing their respective sections of .the report. The drafts that 
are- produced are compiled and readied for the blue pencil of the editor (s); - 
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e. Editing • 

Much of what heeds to be said ab5at editing is nothing isor« thiS. 
a cbmpetent secretary knows Horn exi>erience. But it warrants at least 
a brief inention here 16 emphasiza the importance of the sditing process in 
forging that iiSk between "writing" and "distribution." ; 

We are assuming that most final reports eSanatiSg from a research 
project a^e intended to serve more than one purpose. The immediate need 
is for a concise and accurate report to the funding agency; a second pur- 
pose is to serve as a source of information from which smaller segments 
niay be drawn for presentation in other forms (e.g., journal articles, feed- 
back to participating students, faculty, etc.); a third possibility is 
that the report as a whole may be circulated to certain "significant others" 
-those you have reason to believe would be interested in the outcomes of" 
the project. The editing task(s) becomes increasingly demanding as you 
increase the scope of the intended audience. . 

First-level editing takes place as the sectibhs of the opus are 
being written. That is, thi contributors should be convinced that they 
have said all they have to say on the subject, as well as they are able 
to say it. They should not be embarrassed to send it off as is, either 
for critique by colleagues or for publication. First level editing, .then, 
consists of each author, (in consultation- with one another as desired) 
going over the section to be submitted, checking for accuracy, completeness, 
coherence, and general literacy. 

it the second level, we put all materials in the hands of a : 
- "substantive editor"~someone thoroughly familiar with' the research who 
will review the report as a whole. This person critiques the completed 
draft for things like "saps" in content, redundancy, IbgicaL- consistency , ' 
flow, literacy and clarity. Sections' requiring substantial revisions are 
handed back to ?he authors, and re-writes should take place promptly.' 
■Contributing authors must be available for comment during this time and 
willing to vork with the substantive editor cr forever hold their peace. 
The manuscript is th^ ready for fihar typing; all layout decisions regard,- 
ing "style" (footnotes, references, general format, etc.^ are implemented 
at this point. . . ^ ; 



After final typings* the third-level editing is essentially what 
is more often referred to as "proofing," or editing for detail. The 
"detail editor" is preferably someone who has never seen the report before 
and who therefore sees it with the critical eye of an outsider. This per- 
son reads/every word and checks every reference — a process that is -almost 
psychologically impossible for those who have already worked yith the 
manuscript ad nauccura. Each page is corrected as necessary, atld the report 
is made ready for duplication. # 

D. Dissemination : Finding the intended audience 

Thk end of the lesearch process is sometimes khoyn, in the inner 
circle, as '^the big double D" — standing for Dissemination and Development. 
Quite frankly, it's t6e toughest part of the whole process. .Doing the 
design is fun; collecting' the data is a chore; running the analysis ,is a 
challenge; interpreting and writing up' the results is exciting; but then 
getting anyone else besides your fellow researchers interested in the 
possible significance of the findings—to say liothing of actually under^ 

standing arid using them— well, that's another whole kettle of fish, and 

~._ _ ____ _ *» 

sdsistimes very cold fish at that. 

The immediate audience — the funding agenc^~is easy to find, 
and the reader's interest is asst^red. But let us assxime that you wish to 
increase the report's rekdership beyond those narrow boundaries. In the 
case of the NSSP, with three years of effort behind ^us^ members of the 
research team would find disheartening the prospect of having research 
outcomes do nothing but collect dust on a shelf somewhere in Washington,, 
D^C. To Whom are your findings most useful? to whom are they irihereritly 
interesting? To whom should they be interesting? ; 

It pays to advertise. After answering the above questions to 
your own satisfaction, you, will have ideritified a potential readerr'nip 
for your report. Don't wait for them to come to you with a request; 
suggest that line of action to them directly, or simply furnish them with" . 
a copy of the report accompanied by a letter explaining its relevance to 
tfieir own interests. This step, incidentally^ influences and is influericed 
by some prior budgeting and scheduling decisions—specifically, those con- 
cerning tfie ntxmber of copies to be pririted. How many coSpiiSer.tary copies 
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cafi your budget cover? tJfiat part of ydxir readership can reasonably be 
asked to defray the cost of printing and distribution, and what would such 
a charge be? 

In Chapter IV^ we discussed "feedback": the provision of pre- 
liminary findings to participants during the course of the project. -These 
people are the core of your outside audience; some educational researchers 
hold that they are th'; only person? upon whom the impact of a research 
project is felt directly and through whom the results of that process are 
therefore mediated. Although all participants need not be provided vrLth 

a copy of the fxnai report, they should by all means be informed that such 
^ __ __ _ __ 

a report is available, and how they may obtain a copy. 

in program evaluation, whether focused upon a single camp s or, 
as in the case of the NSSP^ involving several institutions, the faculty 
and administrative personnel of the institution (s) from which your sample 
is drawn constitute a particularly significant audience to whom findings, 
conclusions and/or recomnendatibns are addressed. It is through these 
persons that the impiicatidns of those findings, may influence policy and 
decision-making; this is the channel, therefore, through whiph ah objective 
assessment of an educational program can actually benefit the program. 
The use of evaluation findings in this "formative" sense benefits the 
institution not merely by pointing out a program's strengths and' weaknesses, 
but also by suggesting pathways toward improvement anii toward the benefi- 
cial continuation of such an assessment process. To achieve these valid 
goals of evaluation research, it is often necessary to do more than simply 
inake the final report availal)le. "Dissemination and development," in x 
order to be fully effective, must often take the form of personal inter- 
action with various individuals and groups — explaining the findings along 
with their limitations and import, and inviting questions and discussion. 

In sum, it is not enough: simply to "do" the research. The 

researcher bears also a responsibility to put the laboriously acquired 

information into the hands and minds of those by whom it can be eff ec- 

_■» _ _ 

tively used such that the prcgram, the institution and the profession / 

stand a realistic chance of benefiting from the new knowledge you Ivave 
produced. 
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PROSPECTtJS 

-Tltie: J ivaltiaf'ng j<ars±ng Education: A Researcn Manaal 



1, Bescription of the Book 

a. Xypfe of book 

Reference; supplemental text 

b. Sabiect matter and seopa of; book 

~ All aspects of coinprehensive prdgram evaluation. Content and 
ia^les of research materials are most directly applicable to the evaluation 
of upper-division baccalaureate nursing programs, but are adaptable to the 
evaluation of lower-division as well as graduate programs- 
c- Hajbr theme approach of the book . 

ease study. This approach is based upon the longitudinal and 
comparative multi-campus evaluation currently being conducted by the 
National Second Step Project at Sonoma State University. Emphasis is upon 
the application of principles of evaluation research to specific prob-lems^ 
v^-t^v J-vpica]lv surround aid sometimes overwhelm program 

evalix2tdrs. 

The conceptual framework stresses the dynamic interdependence of 
variables affecting student characteristics, educational patterns and 
structures, and the definition and assessmjt of goal achievement, '.-he 
appropriate and complementary use of both "Quantitative and qualitative 
Research strategies is a recurrent theme throughout the manual. 

this case study approach, consistently citing numerous examples 
bf sound and workable research procedures, provides the basic unifying 
element. Within that illustrative framework, sample materials and theoretical 
considerations are organized and presented according to the step-by^step 
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^.onolo^ of th. r..^rch process, fr.. posing realistic ..d attai^aSle 
objectives tteBugS to producing .the final report. 
Level of: jLnt ended audience 

iSsfig ea„c5«rs .uiroi =tude.ts: th.s. persons constitute ii. Sool.'. 

p.i^ Sai.^ci. (SBE,r-=.fii£tees. c^>.»g.d oontlnu.1 lni£iation. 

aeveibpo^r. ii^iovemint and a=.=^Se5t of lear^g eipSf-enoi=> are . 

prcSaHy pr8««t in ioie 1.40QnUrSing progiais throughout the iition.5 A 
...ondar,- Sd of tsn o.erlappiig audiSSc. obnsisis 51 the gr.=in, nufiber 
of director, and =taff oSoh.r. of externally funded progSai^ev.l.^tion. 
ofEen appended to uuSsihg depSrt«.nts especially in the for„itive y..r. 
of self-study and accreditation activities. 

Othei iudieices .over a tf6ad range of evaluaiSrs. lesmers and 
c„5su».r. .f evaiuaiioh ..s*«.h. f roi institutional consortia and regional 
agencies charged «th the coipar.tlv. evaluatiSh of t.o .r .ore frogra^ to 
undergraduites ih research ciiises. for =ho„ the hook .ight «11 serve as 

a supplementary text. 

: Bh.ther is Students, teachers. "idSinistrator. or evaluators. these 
audiences participate acStvely in nursing education and «e prohiSly 
' fsallar Sth curri.ulsr conieSE. Ho.SV.r. the hook assuSSt no prior 
knovLdg. either Ih th. fi.ld of nuislng^or i« tet«s of evalu.tl.« research. 
The^e are no prerequisites for its use. 

e; Important features o_f the boofe 

i5 ft contain, a detailed exposition of a successful and ei^8ft«le 

lethod.i.gy for program .v.lu.tion. th.or.tic.lly sound and pr.g..ti=any 
^iiciSle. the reseaich design it presenEed complete «lth background, 
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rationale and references - 

2) It is specifically tailored to address the current and 
future needs of nursing, a rapidly expanding field in vhich educational 
prograas are iS process of continual developneSt and transition, and 
where professional accreditation activities necessitate frequeSt self-study 

and evaluatibn- 

3) In addition to explicating the de.-;xgn and analysis » it 
illustrates and inakes avaiiaBle to the reader a complete set of articulated 
instruments for carrying Out the evaluation - 

4) Both the language and the case study apptoach are planned 
to guide readers through the coinplexities of the research process but to 
avoid the intracacies of technical jargon and statistical jninutiae. 

5) Although it is possible to replicate the design in its 
entirety, the manual also considers the needs of readers who prefer to 
modify and adapt it to their own purposes, utilizing certain tools and 
strategies while omitting others. 

2. Description of Illus'trations and Aids ' . 
a. Approximate and &£_ jJ:lnst rat ions 

Illustrations as such ao not appear in the Manual, although five 
whole pages and sections of 12 other pages contain reprints of sample 
research materials such as questionnaire items and format, codebook design, 
and computer programming- All such illustrative materials, however, are 
printed; no drawings or graphs are used with the exception of a scattergram 

on page 95. : 

bi Student aids in book 

Bcplaiiiwry notes appear at the end 5f iost chapters; a complete 
iist of bibliographic references. is provided at the end of the book- 
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c. Supp 1 enent ary studtet^ ^sd^ 
None 

3. Information About the Ilarket 
Kursing Educators 

Doctoral and Master's Students of ^Sursing, Health Gare, Edu£ation, etc. 
Project Directors of training/Educational Programs 
Baccalaureate Nursing Research Students 
b • Secondary market 

General reference for curriculum and program evaluators 
c. Cbmpetitibn 

1) Mien, Moyra. Evaluation of Education a l Prbgramnes . in Nursing > 
Geneva," Switzerland: World Health Organization, 1977. 

2) Green, J. L. and Stone, J. G, Curriculum Evaluation : Theory gnd 
Practice with a Case Study from Nursing Education . New York: 
Springer Publishing Co., 1977. 

3) Steele, Shirley.'^ Educational Evaluaulon in Nursing . Xhorofare, NJ: 
C. B. Slack Co*, 1978. 

. d. Advantages over Competition 

1) The Allen book takes on the large task of defining how nursing 
education can Se looked at and evaluated on a very broad scale (i.e., from 
country to country). It lays out what kind of information to consider in 
each segment of the evaluation, but does not suggest any specific treatment 
of the evidence, the book is not listed in Books^ i^ ^^^^ 
generally available i ^ 

2) The Green and Stone book is much longer ^ more "general" and 
less specifically addressed to the inrmediate needs of nursing educators/ 
evaluatbrs than our Hanud . In a sense, it is geared to educating the 
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erraiuator r^her tnan providing specific tools ar^d assistance. 

3) The Steele book discusses one small (29 students) Master's 
prbgran in Child Health Nursing; Aithoagh there is laich reference to the 
Evaluation literature (especially Stuff lehean, whose Cil^— Context ^ Input 
Process, and Product — is supposedly used), the book as a whole employs an 
almost anecdotal approach, going into cetail oh some topics and skipping 
lightly over others. Its main purpose seems to have been to provide some 
data -for internal use in monitoring and improving the new program. 



